-- Logs begin at Thu 2022-06-30 14:48:37 UTC, end at Thu 2022-06-30 16:09:09 UTC. -- Jun 30 15:42:00.565710 dv-cinder-797608-40-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 15:42:00.574663 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 15:42:00 2022] *** Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: nodename: dv-cinder-797608-40-iscsi Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: machine: x86_64 Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: clock source: unix Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: pcre jit disabled Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: detected number of CPU cores: 4 Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: current working directory: / Jun 30 15:42:00.576288 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: detected binary path: /usr/bin/uwsgi-core Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: your processes number limit is 47680 Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: your memory page size is 4096 bytes Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: detected max file descriptor number: 2048 Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: lock engine: pthread robust mutexes Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: thunder lock: enabled Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 15:42:00.576889 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 15:42:00.621052 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: Python main interpreter initialized at 0x5566d8d5f9c0 Jun 30 15:42:00.621052 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: python threads support enabled Jun 30 15:42:00.621052 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: your server socket listen backlog is limited to 100 connections Jun 30 15:42:00.621052 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: your mercy for graceful operations on workers is 90 seconds Jun 30 15:42:00.621446 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 15:42:00.621446 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: *** Operational MODE: preforking *** Jun 30 15:42:00.621712 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: *** uWSGI is running in multiple interpreter mode *** Jun 30 15:42:00.621712 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: spawned uWSGI master process (pid: 114926) Jun 30 15:42:00.621884 dv-cinder-797608-40-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 15:42:00.627747 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: spawned uWSGI worker 1 (pid: 114927, cores: 1) Jun 30 15:42:00.627747 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: spawned uWSGI worker 2 (pid: 114928, cores: 1) Jun 30 15:42:00.627747 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 15:42:01.280588 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 15:42:01.286360 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 15:42:02.390666 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:42:02.390666 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: from cryptography.utils import int_from_bytes Jun 30 15:42:02.391275 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:42:02.391275 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: from cryptography.utils import int_from_bytes Jun 30 15:42:02.391433 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:42:02.391433 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: from cryptography.utils import int_from_bytes Jun 30 15:42:02.391825 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:42:02.391825 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: from cryptography.utils import int_from_bytes Jun 30 15:42:04.847042 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 15:42:04.847652 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 15:42:04.847757 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 15:42:04.848156 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 15:42:04.848404 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 15:42:04.848785 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.849100 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.849414 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.849727 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.850047 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.850179 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 15:42:04.850562 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.850658 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 15:42:04.850731 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.850935 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 15:42:04.851062 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.851215 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.851308 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 15:42:04.851479 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.851575 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 15:42:04.851811 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.851947 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852104 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-40-iscsi {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852194 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852448 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852583 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852749 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.852885 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853041 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853153 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853350 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853444 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853650 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853742 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.853963 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.854142 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.854236 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.854325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.854553 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.854741 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855166 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855166 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-40-iscsi {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855407 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855516 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855621 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855735 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.855852 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856107 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856240 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856406 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856540 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856720 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.856828 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857034 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857126 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857336 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857451 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857633 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857845 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.857949 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.858241 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.858387 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-40-iscsi {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.858510 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.858707 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.858812 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859019 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859111 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859327 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859420 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859727 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.859821 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860046 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860202 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860369 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860478 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860679 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860778 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.860981 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861088 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861293 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861397 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-40-iscsi {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861603 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861698 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.861913 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862013 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862223 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862330 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862536 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862630 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862831 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.862936 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863131 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863237 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863442 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863535 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863750 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.863854 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864073 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864182 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864368 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864460 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864598 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864743 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.864905 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865037 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865218 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865348 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865527 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865648 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865841 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.865935 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866085 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866241 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866337 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866555 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866653 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866855 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.866944 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867153 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867240 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867403 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867497 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867704 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.867794 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868039 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868151 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868360 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868455 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868656 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868744 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.868914 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869015 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869161 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869250 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869477 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869795 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.869885 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870101 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870266 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870404 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870492 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870704 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.870802 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871007 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871094 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871308 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871397 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871609 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.871697 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.872286 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.872385 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.872590 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.872677 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.872906 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873007 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873215 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873304 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873527 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873623 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873853 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.873942 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874153 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874253 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874455 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874552 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874765 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.874853 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875071 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875165 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875369 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875470 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875613 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.875701 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876013 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876158 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876337 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876436 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876655 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876752 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.876958 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877045 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877256 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877353 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877553 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877649 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877847 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.877935 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878147 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878237 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878447 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878535 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878707 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.878801 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879003 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879100 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879304 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879391 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879594 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879688 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.879895 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880003 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880219 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880344 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880514 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880601 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880810 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.880897 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881112 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881199 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881408 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881503 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881706 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.881795 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882003 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882104 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882301 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882468 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882602 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882784 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.882905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883084 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883205 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883388 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883506 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883699 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.883821 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884035 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884160 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884315 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884464 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884625 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884764 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.884924 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885063 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885223 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885364 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885530 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885679 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885821 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.885980 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886118 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886277 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886425 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886592 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886725 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.886893 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887019 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887193 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887311 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887506 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887595 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887807 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.887904 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888132 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888222 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888444 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888582 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888739 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.888828 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889040 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889128 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889400 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889489 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889704 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.889794 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890006 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890096 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890305 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890393 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890597 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890696 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890892 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.890979 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.891192 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.891288 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.891488 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.891587 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.891786 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.891932 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.892103 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.892207 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.892419 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.892508 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.892734 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.892821 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.893035 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.893133 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.893336 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.893424 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.893639 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.893726 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.893952 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894049 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:42:04.894256 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894346 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894558 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894654 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894860 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.894960 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895170 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895265 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895479 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895574 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895796 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.895893 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896127 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896434 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896523 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896740 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.896829 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897041 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897152 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897349 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897657 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897746 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.897964 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898052 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898263 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898359 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898586 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898684 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898912 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.898999 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899212 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899301 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899524 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899619 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899833 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.899930 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900162 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900253 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900467 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900555 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900766 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.900872 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901073 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901176 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901382 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901469 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901687 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901773 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.901995 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902093 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902301 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902389 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902605 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902693 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.902906 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903008 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903215 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903302 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903519 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903606 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903836 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.903938 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904166 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904254 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904472 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904566 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904777 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.904868 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905149 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905334 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905460 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905644 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905773 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.905950 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906084 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906253 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906398 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906550 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906709 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.906846 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907044 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907132 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907358 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907446 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907671 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907768 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.907980 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908087 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908316 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908404 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908615 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908703 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.908923 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909010 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909222 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909319 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909608 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909822 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.909909 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910121 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910217 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910511 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910715 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.910802 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911014 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911110 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911311 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911400 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911626 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911714 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.911928 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912046 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912264 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912352 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912568 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912654 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912867 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.912954 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913173 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913312 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913479 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913649 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913791 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.913953 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914098 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914257 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914400 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914559 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914718 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.914862 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915025 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915176 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915327 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915484 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915644 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915787 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.915950 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916139 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916280 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916594 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916760 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.916902 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917075 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917209 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917392 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917517 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917700 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917823 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.917995 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918150 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918299 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918458 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918597 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918766 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.918902 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919097 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919199 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919426 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919524 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919729 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.919817 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920043 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920134 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920340 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920428 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920713 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.920853 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921013 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921101 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921321 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921618 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921705 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.921916 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922036 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922207 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922297 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922501 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922590 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922799 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.922886 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923099 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923188 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923398 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923510 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923700 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.923795 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924010 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924101 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924342 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924443 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924650 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924752 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.924949 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925037 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925246 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925382 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925544 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925632 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925843 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.925939 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926145 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926244 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926455 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926543 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926758 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.926846 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927068 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927167 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927369 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927465 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927679 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927768 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.927980 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928102 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928313 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928401 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928607 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928694 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.928912 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929002 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929306 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929533 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929629 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929835 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.929924 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930149 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930236 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930470 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930608 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930777 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.930914 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931083 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931215 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931397 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931532 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931698 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.931818 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932030 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932147 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932371 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932476 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932699 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.932786 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933009 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933099 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933324 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933422 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933629 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933717 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.933926 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934014 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934227 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934323 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934519 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934605 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934821 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.934908 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935125 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935216 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935444 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935530 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935746 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.935842 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936072 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936195 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936466 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936562 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936768 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.936864 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937068 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937164 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937369 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937457 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937666 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937753 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.937966 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938055 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938269 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938371 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938609 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938735 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.938917 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939040 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939224 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939342 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939643 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939850 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.939937 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940183 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940274 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940491 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940599 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940795 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.940895 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941098 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941186 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941406 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941503 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941705 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.941792 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942014 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942100 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942321 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942454 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942620 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942708 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.942917 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943004 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943223 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943319 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943524 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943611 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943822 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.943908 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944152 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944242 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944450 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944538 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944767 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.944866 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945076 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945172 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945373 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945461 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945683 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945780 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.945985 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946071 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946283 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946369 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946589 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946691 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946887 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.946981 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947269 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947479 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947575 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947783 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.947930 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948093 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948192 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948399 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948506 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948702 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.948790 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949005 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949093 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949307 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949397 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949617 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949703 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.949916 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950013 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950306 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950516 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950603 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950812 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.950900 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.951113 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.951203 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.951417 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.951504 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.951724 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952020 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952178 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952351 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952439 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952663 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952754 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.952978 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953066 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953286 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953373 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953593 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953681 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953895 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.953985 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.954201 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.954289 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.954513 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.954609 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.954816 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955076 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955176 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955401 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955488 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955698 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.955787 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956009 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956101 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956325 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956412 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956622 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956710 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.956918 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957008 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957220 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957308 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957515 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957603 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957811 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.957925 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958106 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958194 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958402 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958490 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958706 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.958803 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959001 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959095 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959306 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959396 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959601 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959698 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.959900 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960019 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960234 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960389 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960536 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960689 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960839 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.960986 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961137 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961275 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961439 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961602 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961749 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.961900 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962048 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962227 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962358 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962547 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962671 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962887 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.962975 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963184 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963282 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963482 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963581 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963796 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.963885 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964119 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964213 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964505 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964711 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.964811 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965020 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965147 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965324 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965421 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965618 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965707 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.965921 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966017 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966221 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966311 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966522 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966619 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966824 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.966914 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967120 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967209 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967448 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967603 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967767 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.967857 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968099 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968191 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968504 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968699 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968789 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.968995 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969090 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969298 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969394 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969598 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969686 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969896 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.969983 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970195 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970283 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970492 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970578 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970796 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.970884 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971095 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971191 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971390 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971486 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971684 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971772 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.971983 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972128 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972306 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972394 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972601 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972689 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.972905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973009 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973204 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973292 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973496 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973599 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973792 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.973880 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974089 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974175 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974380 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974476 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974673 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974762 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.974975 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975131 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975277 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975458 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975598 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975767 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.975905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976088 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976232 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976390 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976535 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976685 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976840 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.976981 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977140 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977276 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977442 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977577 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.977870 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978071 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978161 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978385 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978473 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978689 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978781 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.978996 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979087 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979299 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979387 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979596 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979683 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979893 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.979982 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980218 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980309 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980514 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980682 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980810 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.980905 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981109 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981197 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981410 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981508 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981713 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.981802 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982036 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982132 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982342 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982485 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982639 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982727 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.982940 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983029 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983264 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983364 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983560 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983647 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983870 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.983966 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984200 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984291 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984505 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984592 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984801 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.984888 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985094 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985191 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985407 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985495 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985710 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.985805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986014 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986104 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986326 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986412 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986638 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986724 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.986943 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987105 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987252 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987404 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987555 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987708 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.987854 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988032 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988224 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988336 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988536 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988642 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988843 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.988932 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989163 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989250 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989481 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989579 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989791 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.989879 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990090 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990184 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990388 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990485 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990686 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990774 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.990988 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991077 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991287 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991391 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991580 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991669 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991884 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.991971 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992214 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992303 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992512 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992601 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992817 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.992906 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993112 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993203 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993411 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993506 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993704 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.993791 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994005 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994119 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994306 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994425 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994628 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994717 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.994936 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995026 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995236 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995324 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995639 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995841 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.995928 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.996173 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.996264 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.996476 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.996574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997221 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997323 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997525 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997621 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997827 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.997924 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998129 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998423 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998512 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998717 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.998858 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999069 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999158 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999386 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999481 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999682 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999780 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:04.999976 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000146 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000293 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000460 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000654 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000771 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.000892 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001079 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001201 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001388 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001609 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001743 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.001987 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002075 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002310 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002399 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002615 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002763 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.002918 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003068 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003221 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003372 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003544 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003685 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.003849 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004016 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004198 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004336 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004615 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004711 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.004924 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005012 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005223 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005319 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005534 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005621 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005845 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.005933 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006148 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006252 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006451 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006551 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006749 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.006840 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007064 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007153 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007376 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007473 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007681 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.007781 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008010 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008367 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008456 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008693 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.008782 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009002 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009097 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009312 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009401 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009616 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009713 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.009912 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010007 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010209 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010299 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010511 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010600 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010810 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.010899 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011107 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011248 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011423 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011571 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011722 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.011878 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012055 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012229 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012362 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012554 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012667 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012859 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.012952 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013164 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013253 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013474 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013562 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013776 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.013867 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014077 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014173 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014442 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014755 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.014845 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015068 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015158 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015367 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015466 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015670 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015757 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.015971 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016077 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016291 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016392 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016590 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016679 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016886 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.016975 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017203 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017306 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017499 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017595 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017812 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.017909 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018133 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018231 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018537 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018734 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.018823 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019053 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019142 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019355 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019444 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019657 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019752 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.019956 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020130 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020297 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020385 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020595 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020684 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020892 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.020983 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021196 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021285 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021492 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021588 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021789 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.021931 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022086 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022176 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022394 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022491 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022693 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022789 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.022988 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023111 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023283 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023381 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023594 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023684 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.023889 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024007 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024228 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024327 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024528 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024619 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024826 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.024913 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025121 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025512 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025715 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.025802 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026019 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026109 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026318 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026407 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026635 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026724 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.026935 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027025 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027254 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027342 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027556 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027644 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027855 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.027943 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028186 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028276 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028488 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028576 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028796 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.028886 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029108 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029196 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029418 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029524 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029728 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.029816 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030081 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030174 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030388 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030487 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030697 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.030786 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031006 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031103 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031314 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031412 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031624 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031823 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.031937 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.032287 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.032404 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.032593 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.032685 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.032905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033042 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033215 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033318 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033519 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033610 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033825 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.033914 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034129 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034233 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034430 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034731 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.034944 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035042 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035269 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035360 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035579 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035668 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.035889 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036012 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036224 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036315 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036534 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036623 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036845 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.036948 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037153 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037242 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037456 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037543 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037757 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.037855 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038070 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038160 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038378 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038481 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038685 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038776 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.038992 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039081 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039299 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039395 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039604 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039702 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.039907 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040026 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040238 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040340 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040544 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040634 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040848 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.040945 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041147 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041245 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041450 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041540 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041791 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.041905 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042104 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042228 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042417 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042553 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042725 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.042864 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043030 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043170 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043339 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043475 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043647 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043782 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.043953 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.044283 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.044372 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.044594 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.044683 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.044906 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045011 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045228 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045317 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045539 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045650 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045906 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.045995 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046218 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046307 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046528 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046616 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046840 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.046930 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.047137 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.047353 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.047442 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.047663 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.047762 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048009 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048123 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048333 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048448 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048635 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048814 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.048931 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049021 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049242 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049330 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049544 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049642 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.049851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050069 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050157 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050412 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050514 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050738 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.050867 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051040 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051188 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051359 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051509 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051665 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051816 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.051967 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.052143 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.052309 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.052467 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.052617 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.052767 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053065 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053189 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053374 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053515 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053678 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053790 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.053973 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054117 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054270 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054444 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054573 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054760 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.054874 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055066 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055164 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055389 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055488 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055695 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.055785 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056045 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056140 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056335 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056424 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056639 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056727 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.056935 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057026 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057235 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057323 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057526 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057634 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057820 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.057937 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058114 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058231 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058407 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058497 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058709 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.058808 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059003 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059092 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059301 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059410 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059593 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059683 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059893 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.059981 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060211 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060313 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060510 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060601 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060813 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.060902 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061118 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061240 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061476 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061568 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061790 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.061878 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062093 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062193 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062393 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062480 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062693 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062780 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.062996 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063141 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063293 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063390 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063597 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063692 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.063919 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064028 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064280 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064468 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064585 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064796 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.064903 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065146 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065252 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065428 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065516 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065746 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.065843 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066043 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066140 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066340 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066428 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066637 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066739 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.066955 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067052 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067259 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067536 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067645 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067847 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.067938 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068175 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068265 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068480 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068588 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068782 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.068871 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069082 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069171 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069383 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069482 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069686 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069776 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.069988 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070083 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070289 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070386 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070590 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070679 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070890 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.070988 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071195 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071297 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071502 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071592 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071809 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.071897 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072140 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072231 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072445 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072532 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072748 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.072848 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073045 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073147 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073344 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073445 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073643 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073746 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.073943 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074033 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074248 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074336 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074569 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074668 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074871 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.074960 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075168 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075256 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075476 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075566 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075788 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.075878 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076120 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076226 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076429 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076737 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.076826 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077071 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077161 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077382 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077563 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077695 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.077877 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078031 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078188 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078328 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078537 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078681 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078819 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.078995 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079131 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079310 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079433 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079629 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079797 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.079933 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080113 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080342 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080432 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080639 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080728 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.080939 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081042 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081250 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081340 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081553 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081649 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081849 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.081941 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082147 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082236 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082447 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082588 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082742 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.082833 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083035 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083133 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083329 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083425 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083625 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083718 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.083922 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084051 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084244 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084344 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084537 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084634 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084830 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.084918 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085123 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085225 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085416 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085513 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085710 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.085799 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086007 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086104 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086300 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086404 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086595 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086698 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086888 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.086990 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087181 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087272 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087474 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087563 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087781 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.087866 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088110 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088202 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088412 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088500 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088712 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.088803 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089014 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089102 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089311 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089406 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089610 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089700 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.089907 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090009 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090205 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090294 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090504 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090594 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090801 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.090889 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091122 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091221 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091424 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091514 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091730 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.091819 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092055 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092157 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092358 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092447 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092724 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.092875 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093043 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093283 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093373 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093608 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093697 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.093930 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094064 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094230 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094321 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094549 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094640 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094854 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.094959 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095162 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095250 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095466 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095554 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095766 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.095868 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096095 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096187 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096406 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096494 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096709 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.096809 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097015 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097151 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097318 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097408 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097623 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097715 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.097931 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098022 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098240 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098327 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098546 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098636 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098860 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.098948 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099163 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099251 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099466 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099562 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099778 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.099868 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100113 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100222 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100422 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100626 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100719 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.100801 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101029 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101129 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101350 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101438 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101655 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101753 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.101961 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.102060 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.102199 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 15:42:05.102296 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.102585 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.102931 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.103241 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.103580 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.103905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.104246 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.104553 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.104855 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:42:05.105132 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 15:42:05.261343 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Registered counter for database nova_api Jun 30 15:42:05.263856 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO dbcounter [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Registered counter for database nova_api Jun 30 15:42:05.283695 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.287120 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.291561 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.293606 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writer thread running {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.347740 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.context [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd19ca04-a640-4a78-ac68-5d02ec66a735(cell1) {{(pid=114928) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 15:42:05.349554 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.context [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd19ca04-a640-4a78-ac68-5d02ec66a735(cell1) {{(pid=114927) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 15:42:05.351825 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:42:05.353732 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:42:05.354126 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_concurrency.lockutils [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:42:05.354532 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:42:05.355870 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_concurrency.lockutils [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:42:05.356531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:42:05.356685 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_concurrency.lockutils [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:42:05.358599 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Registered counter for database nova_cell0 Jun 30 15:42:05.358726 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_concurrency.lockutils [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114927) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:42:05.360701 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO dbcounter [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Registered counter for database nova_cell0 Jun 30 15:42:05.364231 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Registered counter for database nova_cell1 Jun 30 15:42:05.366201 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO dbcounter [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Registered counter for database nova_cell1 Jun 30 15:42:05.372497 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.374222 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.377892 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.379278 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.381786 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.383221 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.385281 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writer thread running {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.387962 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writer thread running {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.526587 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO dbcounter [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Registered counter for database nova_cell0 Jun 30 15:42:05.530509 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO dbcounter [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Registered counter for database nova_cell0 Jun 30 15:42:05.536355 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_db.sqlalchemy.engines [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.538010 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:42:05.541732 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writer thread running {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.542638 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writer thread running {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:42:05.874187 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: WARNING keystonemiddleware.auth_token [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:42:05.874978 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:42:05.881459 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: WARNING keystonemiddleware.auth_token [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:42:05.882171 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:42:06.220092 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: WARNING keystonemiddleware.auth_token [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:42:06.220606 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:42:06.226089 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: WARNING keystonemiddleware.auth_token [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:42:06.226646 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: WARNING keystonemiddleware.auth_token [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:42:06.231332 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566d8d5f9c0 pid: 114927 (default app) Jun 30 15:42:06.231869 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566d8d5f9c0 pid: 114928 (default app) Jun 30 15:42:06.233475 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:42:06.234682 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-e6b96e76-561f-4074-b532-2d7de5034526 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001804 Jun 30 15:42:06.235119 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Thu Jun 30 15:42:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:21.576404 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:21.577625 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jun 30 15:43:21.580040 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:21.589597 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_api:SELECT=3 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:21.590632 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_cell1:SELECT=3 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:21.591782 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_cell0:SELECT=3 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:21.592759 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:22.029139 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-56a734ad-4210-4d95-ae34-8f89dd0d08ff admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:22.061299 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-56a734ad-4210-4d95-ae34-8f89dd0d08ff admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477074 Jun 30 15:43:22.066510 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 2/3] 10.222.0.50 () {60 vars in 1291 bytes} [Thu Jun 30 15:43:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:24.118417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:24.119417 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-ce442f70-983b-43d3-b5b4-36ab4befb892 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jun 30 15:43:24.119785 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 2/4] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:24.178593 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-17f05d49-86e2-489f-993c-3f5b622c6d55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:24.196239 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:43:24.196239 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: warnings.warn(msg) Jun 30 15:43:24.228478 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-17f05d49-86e2-489f-993c-3f5b622c6d55 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102603 Jun 30 15:43:24.232047 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 3/5] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:24.244458 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:24.246374 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell1:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:24.247824 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell0:SELECT=3 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:24.248795 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:43:24.456578 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-484b12b3-9f7a-4a1f-8f92-b9b066b3611c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:24.458917 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:43:24.458917 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:43:24.521468 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-484b12b3-9f7a-4a1f-8f92-b9b066b3611c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283072 Jun 30 15:43:24.530161 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 3/6] 10.222.0.50 () {64 vars in 1335 bytes} [Thu Jun 30 15:43:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:26.579839 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-17f05d49-86e2-489f-993c-3f5b622c6d55 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:26.580961 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-17f05d49-86e2-489f-993c-3f5b622c6d55 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 30 15:43:26.581361 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 4/7] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:26.685967 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-66eb08fa-f6ef-4984-bbe1-afff79a14fbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:26.703741 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:43:26.703741 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:43:26.723115 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-66eb08fa-f6ef-4984-bbe1-afff79a14fbf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135823 Jun 30 15:43:26.723856 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 4/8] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:26.736006 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-c971f543-7e27-49c5-9398-ee197d195ad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:26.737746 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:43:26.737746 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: warnings.warn(msg) Jun 30 15:43:26.770256 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-c971f543-7e27-49c5-9398-ee197d195ad0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038090 Jun 30 15:43:26.770771 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 5/9] 10.222.0.50 () {64 vars in 1335 bytes} [Thu Jun 30 15:43:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:43:28.849622 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-66eb08fa-f6ef-4984-bbe1-afff79a14fbf admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:28.850632 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-66eb08fa-f6ef-4984-bbe1-afff79a14fbf admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 30 15:43:28.851029 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:28.911610 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7b78c501-5e62-4c91-92b5-374e7fea6e9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "disk": 10, "ram": 1024}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:28.932288 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7b78c501-5e62-4c91-92b5-374e7fea6e9f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075190 Jun 30 15:43:28.933173 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 6/11] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:28.945176 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-7863ec0f-4991-4548-947e-360d019194be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:28.968525 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-7863ec0f-4991-4548-947e-360d019194be admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027133 Jun 30 15:43:28.969098 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 6/12] 10.222.0.50 () {64 vars in 1335 bytes} [Thu Jun 30 15:43:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:31.020233 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7b78c501-5e62-4c91-92b5-374e7fea6e9f admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:31.021178 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7b78c501-5e62-4c91-92b5-374e7fea6e9f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 30 15:43:31.021610 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 7/13] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:31.083247 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-a6574ac4-a667-44d9-9045-219a2d5ce38a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:31.101750 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-a6574ac4-a667-44d9-9045-219a2d5ce38a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074028 Jun 30 15:43:31.102384 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 7/14] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:31.114767 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-f4438c99-2fba-4a29-bfe6-a508300fc8bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:31.140494 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-f4438c99-2fba-4a29-bfe6-a508300fc8bb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029480 Jun 30 15:43:31.141096 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 8/15] 10.222.0.50 () {64 vars in 1335 bytes} [Thu Jun 30 15:43:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:33.209298 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-a6574ac4-a667-44d9-9045-219a2d5ce38a admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:33.210346 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-a6574ac4-a667-44d9-9045-219a2d5ce38a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 30 15:43:33.210748 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 8/16] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:33.280602 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:33.305128 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087522 Jun 30 15:43:33.308440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 9/17] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:33.318156 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-feb5b6ab-7e87-4ad6-bc79-23b8246015ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:33.341423 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-feb5b6ab-7e87-4ad6-bc79-23b8246015ec admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026824 Jun 30 15:43:33.348548 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 9/18] 10.222.0.50 () {64 vars in 1335 bytes} [Thu Jun 30 15:43:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:35.405456 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:35.406644 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jun 30 15:43:35.407407 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 10/19] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:35.477621 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-350b4127-fbeb-4f43-9923-f86f12155525 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:35.511946 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-350b4127-fbeb-4f43-9923-f86f12155525 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098464 Jun 30 15:43:35.512835 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 10/20] 10.222.0.50 () {60 vars in 1291 bytes} [Thu Jun 30 15:43:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:43:37.591356 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:37.592654 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ea6cfc60-6e35-4d4b-b668-e125f880ff70 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001824 Jun 30 15:43:37.593097 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 11/21] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:37.661571 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-453c22d9-7e6f-4303-a54f-395c720026b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:37.683117 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-453c22d9-7e6f-4303-a54f-395c720026b9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082730 Jun 30 15:43:37.683783 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 11/22] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 15:43:37.697049 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-80a57258-436d-4459-bfdd-a98a6069ff84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:37.725756 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-80a57258-436d-4459-bfdd-a98a6069ff84 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032912 Jun 30 15:43:37.726391 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 12/23] 10.222.0.50 () {64 vars in 1332 bytes} [Thu Jun 30 15:43:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:40.048447 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-453c22d9-7e6f-4303-a54f-395c720026b9 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:40.049526 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-453c22d9-7e6f-4303-a54f-395c720026b9 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 30 15:43:40.050203 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:40.120316 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-1a27ba3f-95f0-4121-8432-87f435241a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "swap": 0}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:40.140843 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-1a27ba3f-95f0-4121-8432-87f435241a26 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084037 Jun 30 15:43:40.141578 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 13/25] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 15:43:40.153580 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-803a6a13-7bfd-49f6-b09b-73c99defeee7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:40.177326 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-803a6a13-7bfd-49f6-b09b-73c99defeee7 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027499 Jun 30 15:43:40.177908 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 13/26] 10.222.0.50 () {64 vars in 1332 bytes} [Thu Jun 30 15:43:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:42.339370 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-1a27ba3f-95f0-4121-8432-87f435241a26 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:42.340456 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-1a27ba3f-95f0-4121-8432-87f435241a26 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 30 15:43:42.340834 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 14/27] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:42.412694 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-5554c0fb-95f8-4a9e-a180-202c9179f822 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:42.434206 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-5554c0fb-95f8-4a9e-a180-202c9179f822 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.087171 Jun 30 15:43:42.434770 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 14/28] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:42.447550 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-588bd94e-0115-4d06-8fd1-25dbc68452e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:42.473609 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-588bd94e-0115-4d06-8fd1-25dbc68452e3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029982 Jun 30 15:43:42.474352 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 15/29] 10.222.0.50 () {64 vars in 1332 bytes} [Thu Jun 30 15:43:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:43:44.626336 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-5554c0fb-95f8-4a9e-a180-202c9179f822 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:44.627352 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-5554c0fb-95f8-4a9e-a180-202c9179f822 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 30 15:43:44.627749 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 15/30] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:44.688952 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-5026869a-827a-4931-b53b-a5ea5b820861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 8192}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:44.708438 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-5026869a-827a-4931-b53b-a5ea5b820861 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074782 Jun 30 15:43:44.708987 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 16/31] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:44.721064 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-416e3d67-2876-4cf8-828a-4166761936ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:44.745476 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-416e3d67-2876-4cf8-828a-4166761936ab admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028191 Jun 30 15:43:44.746039 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 16/32] 10.222.0.50 () {64 vars in 1332 bytes} [Thu Jun 30 15:43:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:43:46.867516 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-5026869a-827a-4931-b53b-a5ea5b820861 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:43:46.868616 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-5026869a-827a-4931-b53b-a5ea5b820861 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jun 30 15:43:46.869632 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 17/33] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:43:46.943701 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:46.969142 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.093730 Jun 30 15:43:46.969698 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 17/34] 10.222.0.50 () {64 vars in 1282 bytes} [Thu Jun 30 15:43:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:43:46.981730 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-6d3aefaf-7339-4f09-b6c1-f141765d2ad2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:43:47.009546 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-6d3aefaf-7339-4f09-b6c1-f141765d2ad2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031477 Jun 30 15:43:47.010254 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 18/35] 10.222.0.50 () {64 vars in 1332 bytes} [Thu Jun 30 15:43:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:44:11.058287 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:11.059777 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Jun 30 15:44:11.060372 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:11.076577 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:44:11.127370 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-c886e754-5884-4286-82b1-5c5846ecfa8e admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:11.144310 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-c886e754-5884-4286-82b1-5c5846ecfa8e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075156 Jun 30 15:44:11.144841 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 19/37] 10.222.0.50 () {60 vars in 1291 bytes} [Thu Jun 30 15:44:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:12.083173 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:12.084238 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d37d3325-5289-4d37-b3df-5a9099c5f071 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 30 15:44:12.084626 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:12.283437 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-674f4f71-07fa-4606-b527-f864f9231253 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:12.290449 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.wsgi [None req-674f4f71-07fa-4606-b527-f864f9231253 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-674f4f71-07fa-4606-b527-f864f9231253 admin admin] Request method failure captured: Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept: application/json Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept-Encoding: gzip, deflate Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Connection: keep-alive Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Content-Length: 0 Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Host: 10.222.0.50 Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-System-Scope: None Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: User-Agent: python-novaclient Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Auth-Token: gAAAAABivcTMrlDEIoXSKX2G1qeIUPNXhpPkZvgrOr-pZmMv3Gi0i9thY6p_TFYzy9FLGNnFbf0YURr5chI-opZnPu8U43NFaWokDY_58DdSBv4xFflbc0_uH08F6e4I1OySF9N3C63Hk9Z-y77Lbr2Xd3LukJKIkWmfmkX4hiketHfRXYQUuYk Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Id: None Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Name: None Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Identity-Status: Confirmed Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Is-Admin-Project: True Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Id: default Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Name: Default Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Name: admin Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Role: member,reader,admin Jun 30 15:44:12.293805 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Roles: member,reader,admin Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant: admin Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Name: admin Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User: admin Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Id: default Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Name: Default Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Name: admin Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: method: > Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: exception: Flavor 42 could not be found. Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: action_args: {'id': '42'} Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:12.295541 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:12.297114 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.298522 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-674f4f71-07fa-4606-b527-f864f9231253 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:12.299855 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-674f4f71-07fa-4606-b527-f864f9231253 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073616 Jun 30 15:44:12.299855 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 20/39] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Jun 30 15:44:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 15:44:12.305212 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-057ccac1-e74c-4f65-bc95-707e37f69763 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:12.308184 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:44:12.327811 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-057ccac1-e74c-4f65-bc95-707e37f69763 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026170 Jun 30 15:44:12.328432 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 20/40] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:12.338741 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-dbabd815-0497-410f-8dc8-8a63533d4262 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:12.360252 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-dbabd815-0497-410f-8dc8-8a63533d4262 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025388 Jun 30 15:44:12.360908 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 21/41] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:12.371500 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-92b82306-19c3-4158-9035-ea93727beb30 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:12.378197 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-92b82306-19c3-4158-9035-ea93727beb30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-92b82306-19c3-4158-9035-ea93727beb30 admin admin] Request method failure captured: Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept: application/json Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Host: 10.222.0.50 Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABivcTMrlDEIoXSKX2G1qeIUPNXhpPkZvgrOr-pZmMv3Gi0i9thY6p_TFYzy9FLGNnFbf0YURr5chI-opZnPu8U43NFaWokDY_58DdSBv4xFflbc0_uH08F6e4I1OySF9N3C63Hk9Z-y77Lbr2Xd3LukJKIkWmfmkX4hiketHfRXYQUuYk Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Role: member,reader,admin Jun 30 15:44:12.381630 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Roles: member,reader,admin Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User: admin Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: method: > Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: exception: Flavor 42 could not be found. Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: action_args: {'id': '42'} Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:12.382958 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:12.388371 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:12.389507 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-92b82306-19c3-4158-9035-ea93727beb30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:12.390508 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-92b82306-19c3-4158-9035-ea93727beb30 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016227 Jun 30 15:44:12.390508 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Jun 30 15:44:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 15:44:13.202162 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-dbabd815-0497-410f-8dc8-8a63533d4262 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:13.203181 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-dbabd815-0497-410f-8dc8-8a63533d4262 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 30 15:44:13.203610 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 22/43] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:13.403613 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-1b405969-7397-462a-aa57-97da286772ec admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:13.410133 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-1b405969-7397-462a-aa57-97da286772ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-1b405969-7397-462a-aa57-97da286772ec admin admin] Request method failure captured: Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept: application/json Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Host: 10.222.0.50 Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABivcTNco5uXhT__NntJ0gHJScIj0su2ZVLm3vgKQY2xCLk23uAxXSIn8n0iQNvjJm4Sxhl_tErsvrgpcJXMw5m3oZLY0ntRXrvQwbT7U2txSk9QCxoqt8DrtBUj1tqMWD-xBCaefo-UgPkQGJmUfLtJSKzLt0lfHwm3enpGnDkmvqWhCc Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Role: member,reader,admin Jun 30 15:44:13.411574 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Roles: member,reader,admin Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User: admin Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: method: > Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: exception: Flavor 84 could not be found. Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: action_args: {'id': '84'} Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:13.413182 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:13.414150 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.415531 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-1b405969-7397-462a-aa57-97da286772ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:13.416959 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-1b405969-7397-462a-aa57-97da286772ec admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070706 Jun 30 15:44:13.416959 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Jun 30 15:44:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 15:44:13.422982 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-8f820736-1312-4cf2-a5b1-6f4f834701dd admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:13.438377 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-8f820736-1312-4cf2-a5b1-6f4f834701dd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019155 Jun 30 15:44:13.438916 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:13.448527 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-4aa478c9-66db-44c1-9869-a3ca0d6f3a92 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:13.463856 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-4aa478c9-66db-44c1-9869-a3ca0d6f3a92 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018952 Jun 30 15:44:13.464480 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:44:13.473809 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-248116b2-e03f-4a97-854b-b47c082878a9 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:13.479303 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.wsgi [None req-248116b2-e03f-4a97-854b-b47c082878a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-248116b2-e03f-4a97-854b-b47c082878a9 admin admin] Request method failure captured: Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept: application/json Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept-Encoding: gzip, deflate Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Connection: keep-alive Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Content-Length: 0 Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Host: 10.222.0.50 Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-System-Scope: None Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: User-Agent: python-novaclient Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Auth-Token: gAAAAABivcTNco5uXhT__NntJ0gHJScIj0su2ZVLm3vgKQY2xCLk23uAxXSIn8n0iQNvjJm4Sxhl_tErsvrgpcJXMw5m3oZLY0ntRXrvQwbT7U2txSk9QCxoqt8DrtBUj1tqMWD-xBCaefo-UgPkQGJmUfLtJSKzLt0lfHwm3enpGnDkmvqWhCc Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Id: None Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Name: None Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Identity-Status: Confirmed Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Is-Admin-Project: True Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Id: default Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Name: Default Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Name: admin Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Role: member,reader,admin Jun 30 15:44:13.480851 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Roles: member,reader,admin Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant: admin Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Name: admin Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User: admin Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Id: default Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Name: Default Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Name: admin Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: method: > Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: exception: Flavor 84 could not be found. Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: action_args: {'id': '84'} Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:13.482436 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:13.483325 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:13.484440 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-248116b2-e03f-4a97-854b-b47c082878a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:13.485568 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-248116b2-e03f-4a97-854b-b47c082878a9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012010 Jun 30 15:44:13.485568 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 24/47] 10.222.0.50 () {60 vars in 1190 bytes} [Thu Jun 30 15:44:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 15:44:14.317351 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-4aa478c9-66db-44c1-9869-a3ca0d6f3a92 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:14.318356 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-4aa478c9-66db-44c1-9869-a3ca0d6f3a92 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 30 15:44:14.318745 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 24/48] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:14.517127 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-6e57f6f9-b987-4095-8e36-d14854eac7d8 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:14.523064 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.wsgi [None req-6e57f6f9-b987-4095-8e36-d14854eac7d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-6e57f6f9-b987-4095-8e36-d14854eac7d8 admin admin] Request method failure captured: Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept: application/json Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Accept-Encoding: gzip, deflate Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Connection: keep-alive Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Content-Length: 0 Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Host: 10.222.0.50 Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Openstack-System-Scope: None Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: User-Agent: python-novaclient Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Auth-Token: gAAAAABivcTOkPOlG35B9tRxxaGyTIe9dme53tG18CZG1hfUNf_SldXKBkbNpt8ZkaNlmNldq8xAGQrzeow9jeaSYZ-3DXOEWfMyGW2igOzXejVnnaV1u1gqiGNx4dBCY7_uaLQ-dc1f9YFTbzyVR2tIe-GlY5m7wcMMl_fiQNMQWv8Lp47pOZQ Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Id: None Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Domain-Name: None Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Identity-Status: Confirmed Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Is-Admin-Project: True Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Id: default Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Domain-Name: Default Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Project-Name: admin Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Role: member,reader,admin Jun 30 15:44:14.524519 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Roles: member,reader,admin Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant: admin Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-Tenant-Name: admin Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User: admin Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Id: default Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Domain-Name: Default Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: X-User-Name: admin Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: method: > Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: exception: Flavor 451 could not be found. Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: action_args: {'id': '451'} Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:14.525905 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:14.526706 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.527747 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-6e57f6f9-b987-4095-8e36-d14854eac7d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114927) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:14.529106 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-6e57f6f9-b987-4095-8e36-d14854eac7d8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068815 Jun 30 15:44:14.529106 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 25/49] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:44:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 15:44:14.536395 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-c7f01b16-3f73-457e-84d9-e9e0bbde7c00 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:14.550185 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-c7f01b16-3f73-457e-84d9-e9e0bbde7c00 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017473 Jun 30 15:44:14.550694 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 25/50] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:14.560149 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:14.574292 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017678 Jun 30 15:44:14.574804 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 26/51] 10.222.0.50 () {60 vars in 1210 bytes} [Thu Jun 30 15:44:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:44:14.583948 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-7372d097-838b-46fa-b534-e6efa2ef5218 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:14.589391 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.wsgi [None req-7372d097-838b-46fa-b534-e6efa2ef5218 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-7372d097-838b-46fa-b534-e6efa2ef5218 admin admin] Request method failure captured: Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept: application/json Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Accept-Encoding: gzip, deflate Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Connection: keep-alive Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Content-Length: 0 Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Host: 10.222.0.50 Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-Api-Version: compute 2.90 Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Openstack-System-Scope: None Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: User-Agent: python-novaclient Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Auth-Token: gAAAAABivcTOkPOlG35B9tRxxaGyTIe9dme53tG18CZG1hfUNf_SldXKBkbNpt8ZkaNlmNldq8xAGQrzeow9jeaSYZ-3DXOEWfMyGW2igOzXejVnnaV1u1gqiGNx4dBCY7_uaLQ-dc1f9YFTbzyVR2tIe-GlY5m7wcMMl_fiQNMQWv8Lp47pOZQ Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Id: None Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Domain-Name: None Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Identity-Status: Confirmed Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Is-Admin-Project: True Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Id: default Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Domain-Name: Default Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Project-Name: admin Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Role: member,reader,admin Jun 30 15:44:14.590884 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Roles: member,reader,admin Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/052c2602e738443cb84400121f999c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_052c2602e738443cb84400121f999c4f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/052c2602e738443cb84400121f999c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant: admin Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Id: 052c2602e738443cb84400121f999c4f Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-Tenant-Name: admin Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User: admin Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Id: default Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Domain-Name: Default Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Id: 3a26439857af474a895fe8556a7e3453 Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: X-User-Name: admin Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: method: > Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: exception: Flavor 451 could not be found. Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: action_args: {'id': '451'} Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:44:14.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:14.593403 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: ERROR nova.api.openstack.wsgi Jun 30 15:44:14.594712 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-7372d097-838b-46fa-b534-e6efa2ef5218 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:44:14.595976 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-7372d097-838b-46fa-b534-e6efa2ef5218 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011780 Jun 30 15:44:14.595976 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 26/52] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:44:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 15:44:15.420386 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:15.421506 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jun 30 15:44:15.421901 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:15.621664 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-576d18da-1a62-4e9e-b297-83793f5e0c0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:44:15.646571 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-576d18da-1a62-4e9e-b297-83793f5e0c0b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.087449 Jun 30 15:44:15.647121 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 27/54] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Jun 30 15:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:44:16.487864 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:16.488951 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 30 15:44:16.489346 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:16.695537 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-b6644ee9-e7e4-42b7-843f-520c21c76b37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:44:16.715097 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-b6644ee9-e7e4-42b7-843f-520c21c76b37 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085487 Jun 30 15:44:16.715625 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 28/56] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Jun 30 15:44:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:44:17.544143 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:17.545153 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 30 15:44:17.545561 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 29/57] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:17.750909 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-34455088-a1aa-4a20-b959-0d45fa323454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:44:17.771078 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-34455088-a1aa-4a20-b959-0d45fa323454 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085876 Jun 30 15:44:17.771644 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 29/58] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Jun 30 15:44:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:44:18.589565 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:18.590613 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 30 15:44:18.591023 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 30/59] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:18.792178 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0d2c0add-4e86-45b6-b080-44cef887c4aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:44:18.812978 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0d2c0add-4e86-45b6-b080-44cef887c4aa admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085301 Jun 30 15:44:18.813446 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 30/60] 10.222.0.50 () {64 vars in 1235 bytes} [Thu Jun 30 15:44:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:44:19.631439 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:19.632507 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 30 15:44:19.632888 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 31/61] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:44:19.839298 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-cae9073d-94f7-493c-ac65-bad03cba34ea admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:44:19.858112 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-cae9073d-94f7-493c-ac65-bad03cba34ea admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086415 Jun 30 15:44:19.858626 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 31/62] 10.222.0.50 () {60 vars in 1202 bytes} [Thu Jun 30 15:44:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:45:06.620478 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.621765 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-7010df12-260f-4193-9e60-94b165721b5c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 30 15:45:06.622151 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 32/63] 10.222.0.50 () {54 vars in 930 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:45:06.636051 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:45:06.687335 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-340dda73-87a8-4283-b3c4-caadcd6dc26c admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.712676 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-340dda73-87a8-4283-b3c4-caadcd6dc26c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084217 Jun 30 15:45:06.713217 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 32/64] 10.222.0.50 () {60 vars in 1291 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:45:06.736287 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-0e690194-fc22-4abd-a0eb-5bce414dd450 admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.739809 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG dbcounter [-] [114927] Writing DB stats nova_api:SELECT=14 {{(pid=114927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:45:06.745599 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-0e690194-fc22-4abd-a0eb-5bce414dd450 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013193 Jun 30 15:45:06.746437 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 33/65] 10.222.0.50 () {60 vars in 1282 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:45:06.757879 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-7b1a3fb1-2d40-44a6-b559-457bf8cf59c5 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.766029 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-7b1a3fb1-2d40-44a6-b559-457bf8cf59c5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011743 Jun 30 15:45:06.766551 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 33/66] 10.222.0.50 () {60 vars in 1285 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:45:06.783716 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.791278 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012956 Jun 30 15:45:06.791831 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 34/67] 10.222.0.50 () {60 vars in 1285 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:45:06.806684 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-d8d054f1-be3e-46e3-8a9f-f37d928f7ad5 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:45:06.814328 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-d8d054f1-be3e-46e3-8a9f-f37d928f7ad5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011158 Jun 30 15:45:06.814839 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 34/68] 10.222.0.50 () {60 vars in 1282 bytes} [Thu Jun 30 15:45:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:48:28.883439 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:28.884478 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 30 15:48:28.884837 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 35/69] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:48:29.022297 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=6 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:48:29.138828 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:29.140198 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:48:29.140198 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:48:29.141445 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:29.141878 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:29.142640 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:29.143055 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:29.177545 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-5ef6c8fb-5458-43ac-bd8f-79ac75f10f02 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156560 Jun 30 15:48:29.178109 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 35/70] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:48:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:48:30.016570 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:30.017584 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 30 15:48:30.017968 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 36/71] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:48:30.219293 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:30.220773 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:48:30.220773 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:48:30.222555 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:30.223142 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:30.224373 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:30.224837 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:30.246925 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-08e96de8-72b2-4e0e-a8a0-940ad51ab9e3 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.089617 Jun 30 15:48:30.247466 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:48:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:48:41.498291 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:41.499618 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Jun 30 15:48:41.500158 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 37/73] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:48:41.639568 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell0:SELECT=4 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:48:41.640265 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_cell1:SELECT=4 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:48:41.640868 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG dbcounter [-] [114928] Writing DB stats nova_api:SELECT=8 {{(pid=114928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:48:41.697693 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:41.699571 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:48:41.699571 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:48:41.701495 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:41.701932 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:41.702701 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:41.703122 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:41.727911 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-c37016ea-4964-46c2-83d1-bc8021d2363a admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089660 Jun 30 15:48:41.728488 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 37/74] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:48:41 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:48:42.568783 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: DEBUG nova.api.openstack.wsgi [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] Calling method '>' {{(pid=114927) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:42.569788 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: INFO nova.api.openstack.requestlog [None req-ba3c28b6-d7e5-4e23-9441-471879a6c3db admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 30 15:48:42.570367 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: [pid: 114927|app: 0|req: 38/75] 10.222.0.50 () {56 vars in 1074 bytes} [Thu Jun 30 15:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:48:42.781625 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG nova.api.openstack.wsgi [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] Calling method '>' {{(pid=114928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:48:42.782832 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 15:48:42.782832 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: warnings.warn(msg) Jun 30 15:48:42.784021 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:42.784495 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:42.785292 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:48:42.785717 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: DEBUG oslo_concurrency.lockutils [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:48:42.806876 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: INFO nova.api.openstack.requestlog [None req-0bd8dffc-f0e1-4b48-b981-ddcd48e6c560 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090943 Jun 30 15:48:42.807410 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: [pid: 114928|app: 0|req: 38/76] 10.222.0.50 () {60 vars in 1193 bytes} [Thu Jun 30 15:48:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:49:39.133290 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: Thu Jun 30 15:49:39 2022 - graceful shutdown triggered... Jun 30 15:49:39.133843 dv-cinder-797608-40-iscsi devstack@n-api.service[114928]: Gracefully killing worker 2 (pid: 114928)... Jun 30 15:49:39.134216 dv-cinder-797608-40-iscsi devstack@n-api.service[114927]: Gracefully killing worker 1 (pid: 114927)... Jun 30 15:49:39.134857 dv-cinder-797608-40-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 15:49:40.134536 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: worker 1 buried after 1 seconds Jun 30 15:49:40.134536 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: worker 2 buried after 1 seconds Jun 30 15:49:40.134536 dv-cinder-797608-40-iscsi devstack@n-api.service[114926]: goodbye to uWSGI. Jun 30 15:49:40.136226 dv-cinder-797608-40-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 15:49:40.136812 dv-cinder-797608-40-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 15:49:40.139686 dv-cinder-797608-40-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 15:49:40.150607 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 15:49:40.153326 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 15:49:40 2022] *** Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: nodename: dv-cinder-797608-40-iscsi Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: machine: x86_64 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: clock source: unix Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: pcre jit disabled Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: detected number of CPU cores: 4 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: current working directory: / Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: detected binary path: /usr/bin/uwsgi-core Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: your processes number limit is 47680 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: your memory page size is 4096 bytes Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: detected max file descriptor number: 2048 Jun 30 15:49:40.153524 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: lock engine: pthread robust mutexes Jun 30 15:49:40.154407 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: thunder lock: enabled Jun 30 15:49:40.154407 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 15:49:40.154407 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 15:49:40.198250 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: Python main interpreter initialized at 0x56292b3279c0 Jun 30 15:49:40.198250 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: python threads support enabled Jun 30 15:49:40.198250 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: your server socket listen backlog is limited to 100 connections Jun 30 15:49:40.198250 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: your mercy for graceful operations on workers is 90 seconds Jun 30 15:49:40.198730 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 15:49:40.198730 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: *** Operational MODE: preforking *** Jun 30 15:49:40.198954 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: *** uWSGI is running in multiple interpreter mode *** Jun 30 15:49:40.199160 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: spawned uWSGI master process (pid: 129436) Jun 30 15:49:40.199332 dv-cinder-797608-40-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 15:49:40.199930 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: spawned uWSGI worker 1 (pid: 129449, cores: 1) Jun 30 15:49:40.203682 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: spawned uWSGI worker 2 (pid: 129450, cores: 1) Jun 30 15:49:40.203927 dv-cinder-797608-40-iscsi devstack@n-api.service[129436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 15:49:40.855438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 15:49:40.856113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 15:49:42.044205 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:49:42.044205 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: from cryptography.utils import int_from_bytes Jun 30 15:49:42.044869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:49:42.044869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: from cryptography.utils import int_from_bytes Jun 30 15:49:42.045004 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:49:42.045004 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: from cryptography.utils import int_from_bytes Jun 30 15:49:42.045385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 15:49:42.045385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: from cryptography.utils import int_from_bytes Jun 30 15:49:44.445208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 15:49:44.445778 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 15:49:44.446081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 15:49:44.446333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 15:49:44.446588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 15:49:44.447214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.447354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.447606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.447923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.448305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.448585 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.448906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.449254 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.449697 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.450070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.450389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.450707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-40-iscsi {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.451025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.451331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.451637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.451781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 15:49:44.452217 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.452298 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 15:49:44.452371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.452584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 15:49:44.452691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.452841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.452941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 15:49:44.453212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 15:49:44.453368 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.454936 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.455920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.456265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.456478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.456727 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.456938 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.457161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.457407 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.457622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.457838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.458058 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.458287 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-40-iscsi {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.458510 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-40-iscsi {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.458732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.458942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.459158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.459403 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.459715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.459924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.459924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.460390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.460609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.460835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.461963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462312 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462469 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.462977 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463132 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463591 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.463901 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.464063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.464244 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.464401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.464547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465283 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465632 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465945 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.465945 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.466234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-40-iscsi {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.466387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.466532 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.466676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.466866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467364 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.467980 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.468175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.468322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.468322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.468615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.468860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469022 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469647 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469808 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.469968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470120 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470565 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.470861 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471006 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471159 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471776 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.471932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472307 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.472911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.473847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474004 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.474783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.475492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.475658 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.475808 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.475966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476173 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476330 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476788 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.476933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.477864 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478175 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478631 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478776 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.478927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479244 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.479847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.480226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.480226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.480569 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.480854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481819 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.481973 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.482895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.483948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484197 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484358 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484657 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.484965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.485631 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.485802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.485949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.485949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.486239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.486391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.486537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.486707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.486853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487763 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.487909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488091 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488239 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488397 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488720 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.488872 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489314 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489546 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489701 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.489845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490760 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.490989 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491460 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.491895 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492531 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.492986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.493130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.493603 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.493758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.493919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494222 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.494991 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.495137 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.495810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.495973 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.496181 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.496337 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.496489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.496640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.496786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.496933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.497095 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.497241 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.497385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.497583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.497729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.497874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.498027 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.498181 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.498326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.498478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.498622 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.498779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.498933 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.499078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.499220 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.499398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.499564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.499719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.499867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.500116 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.500265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.500410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.500554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.500714 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.500867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.501041 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.501265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.501415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.501576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.501731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 15:49:44.501877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502643 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.502806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503351 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503833 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.503978 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504363 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504814 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.504966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.505119 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.505274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.505848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.506898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.507059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.507215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.507372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.507524 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.507678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508690 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.508994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509447 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.509889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510343 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510641 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.510949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511817 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.511963 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512289 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512672 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512829 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.512974 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513127 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513279 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513431 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.513900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514334 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.514965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.515118 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.515273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.515419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.515419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.516174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.516433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.516594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.516752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.516910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517096 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517550 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.517930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518116 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518410 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518718 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.518872 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519477 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519631 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.519778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.520864 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521340 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.521886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522627 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522771 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.522928 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523696 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.523855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.524040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.524769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.524939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.525097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.525255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.525410 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.525578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.526165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.526328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.526581 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.526732 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.526894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527050 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527627 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.527927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.528883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529181 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529798 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.529945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530109 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530266 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530573 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.530874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.531914 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.532965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533408 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.533879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534036 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534200 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534360 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534660 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.534950 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535095 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535254 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535401 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535691 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.535861 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.536530 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.536812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.536982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537296 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.537919 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538375 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538691 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.538853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539004 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539319 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.539945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.540927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.541898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542129 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542772 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.542925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.543894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.544929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545101 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.545870 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.546051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.546632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.546844 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547401 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547563 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.547887 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.548995 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.549167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.549408 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.549571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.549723 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.549894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550368 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550520 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.550840 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551000 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.551939 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.552130 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.552379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.552538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.552701 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.552853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553005 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553813 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.553966 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.554758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555054 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555668 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.555818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.556010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.556169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.556734 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.556919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557091 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557502 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.557966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558126 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558288 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.558933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559407 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559718 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.559877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.560890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561687 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.561839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562004 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.562933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563101 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.563902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564091 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.564904 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565068 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.565855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.566015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.566167 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.567326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.567599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.567769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.567923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.568202 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.568358 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.568526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.568688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.568849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569003 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569307 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569469 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.569942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570277 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570737 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.570889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571359 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571521 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.571833 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572359 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572520 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.572927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573087 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573568 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573738 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.573738 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.576517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.576716 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.576902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.577507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.577793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.577966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.578172 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.578335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.578498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.578961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579139 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579787 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.579971 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.580325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.580482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.580636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.580636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.580932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.581906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582400 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582735 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.582970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583629 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.583942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584141 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584360 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584677 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.584982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585521 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.585999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.586956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.587109 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.587692 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.587942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588299 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588776 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.588929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589744 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.589901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590062 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.590992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.591947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.592954 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.593267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.593429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.593587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.593785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.593939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.594883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595687 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.595874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596572 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596734 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.596895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.597057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.597210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.597389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598426 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598742 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.598902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599062 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.599859 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600050 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600393 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600705 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.600857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601160 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601327 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601479 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601631 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.601800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602420 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602581 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602742 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.602896 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.603054 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.603386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.603556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.603723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.603886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604068 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604397 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604561 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.604877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605038 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.605980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606761 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.606914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.607074 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.607237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.607398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.607934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.608170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.608335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.608335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.608335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.608890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609043 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609432 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.609912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610388 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.610708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611644 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611796 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.611956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612535 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.612994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.613162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.613343 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.613343 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.613729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.613892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614524 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614676 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.614827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.615891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616235 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.616858 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.617024 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.617177 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.617345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.617510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.617669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.618161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.618746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.618907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619390 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619714 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.619878 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620542 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620697 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.620851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621174 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.621972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.622996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.623156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.623322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.623495 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.623731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.623887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.624927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625652 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.625966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626126 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626126 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626443 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.626930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627393 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.627865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.628363 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.628539 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.628695 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.628968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629319 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.629956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.630901 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631053 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631228 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.631976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.632199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.632379 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.632609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.632766 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.632918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633411 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633745 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.633974 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.634917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635712 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.635872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636235 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636709 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.636872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.637025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.637185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.637185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.637487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.638582 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.638751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.638913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.639187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.639348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.639545 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.639700 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.639860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640257 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640424 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640658 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640820 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.640974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.641923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642076 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642076 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642388 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642555 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.642976 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.643920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644675 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644993 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.644993 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.645309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.645463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.645623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.645782 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.645942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.646931 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.647872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.648044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.648213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.648213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.648921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.649084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.649436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.649618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.649781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.649943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.650104 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.650266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.650428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.650582 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.650990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651153 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.651939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652267 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652617 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.652970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653702 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.653992 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654086 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.654946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655355 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655743 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.655943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656362 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656449 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656536 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656820 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656910 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.656998 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657438 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657629 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657726 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.657914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.658949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659238 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.659959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660381 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660748 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.660935 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661033 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661131 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661220 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661320 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661320 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661875 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.661962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662598 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662693 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.662996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663455 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663639 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663829 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.663925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664030 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664030 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664304 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664390 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664813 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.664911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665402 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665508 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665607 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665888 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.665975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666070 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666170 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666453 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666630 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666816 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.666911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667006 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667095 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667199 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667617 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667816 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.667904 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668312 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668412 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668501 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.668981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669159 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669339 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.669857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.670944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671424 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671700 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671849 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.671946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672241 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672704 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.672989 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673178 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673450 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.673876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674035 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.674966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675137 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675231 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675640 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.675869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676170 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676411 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676638 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.676887 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677007 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677241 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677363 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677733 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.677959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678071 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678539 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678652 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.678780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679479 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679599 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679727 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679858 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.679954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680159 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680531 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.680936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681431 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.681867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682035 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682125 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682660 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682746 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682841 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.682930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683677 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683763 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.683958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684183 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684487 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684730 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.684967 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685698 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685852 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.685935 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686253 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686437 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.686937 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687229 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687302 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687431 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.687980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688087 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688188 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688477 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688767 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688864 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.688980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689764 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.689916 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.690945 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691041 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691239 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691413 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691698 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.691890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692188 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692376 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692599 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692791 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.692975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693235 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693330 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693522 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.693842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694045 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694154 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694473 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694776 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.694989 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695730 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.695910 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696131 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.696980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697277 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.697957 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698229 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698569 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.698892 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699792 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.699937 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.700158 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.700303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.700527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.700659 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.700817 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 15:49:44.700923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.701242 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.701558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.701882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.702205 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.702525 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.702839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.703227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.703544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.703933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.704300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.704616 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.704931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.705247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.705575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.705911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.706218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.706548 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.706869 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.707190 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.707509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.707821 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.708174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.708493 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.708807 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.709123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.709435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.709746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.710065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.710386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.710719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.711046 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.711360 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.711686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.712028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.712381 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.712698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.713047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.713381 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.713699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.714014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.714321 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 15:49:44.714563 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 15:49:44.762288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO dbcounter [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Registered counter for database nova_api Jun 30 15:49:44.775527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO dbcounter [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Registered counter for database nova_api Jun 30 15:49:44.784507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_db.sqlalchemy.engines [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.792720 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writer thread running {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:44.795630 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_db.sqlalchemy.engines [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.802240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writer thread running {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:44.849831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.context [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd19ca04-a640-4a78-ac68-5d02ec66a735(cell1) {{(pid=129449) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 15:49:44.853978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:49:44.855588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:49:44.856406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:49:44.858128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.context [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd19ca04-a640-4a78-ac68-5d02ec66a735(cell1) {{(pid=129450) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 15:49:44.858398 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:49:44.860484 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO dbcounter [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Registered counter for database nova_cell0 Jun 30 15:49:44.862423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:49:44.864202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:49:44.864572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO dbcounter [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Registered counter for database nova_cell1 Jun 30 15:49:44.865039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:49:44.867511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:49:44.869959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO dbcounter [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Registered counter for database nova_cell0 Jun 30 15:49:44.872287 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_db.sqlalchemy.engines [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.874384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_db.sqlalchemy.engines [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.874574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO dbcounter [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Registered counter for database nova_cell1 Jun 30 15:49:44.881468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writer thread running {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:44.882758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writer thread running {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:44.883016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_db.sqlalchemy.engines [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.885308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_db.sqlalchemy.engines [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:44.891089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writer thread running {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:44.892428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writer thread running {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:45.028123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO dbcounter [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Registered counter for database nova_cell0 Jun 30 15:49:45.035131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_db.sqlalchemy.engines [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:45.038961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO dbcounter [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Registered counter for database nova_cell0 Jun 30 15:49:45.039914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writer thread running {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:45.045525 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_db.sqlalchemy.engines [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 15:49:45.050594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writer thread running {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 15:49:45.365775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: WARNING keystonemiddleware.auth_token [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:49:45.369465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: WARNING keystonemiddleware.auth_token [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:49:45.373376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: WARNING keystonemiddleware.auth_token [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:49:45.376811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: WARNING keystonemiddleware.auth_token [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:49:45.714410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: WARNING keystonemiddleware.auth_token [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:49:45.716933 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: WARNING keystonemiddleware.auth_token [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 15:49:45.720701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: WARNING keystonemiddleware.auth_token [None req-8d7c7493-a8d3-4af2-9442-c6353b1298fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:49:45.722989 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: WARNING keystonemiddleware.auth_token [None req-d54eeb25-4473-4b36-a0f1-03d31f5288c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 15:49:45.726001 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56292b3279c0 pid: 129450 (default app) Jun 30 15:49:45.728371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56292b3279c0 pid: 129449 (default app) Jun 30 15:50:26.195964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:26.197130 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:26.198434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:26.199329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:27.572533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a003fcd2-546b-46fa-9560-68bac0d337f1 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Action: 'create', calling method: .version_select at 0x7fbbdc5eb3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1523631960", "metadata": {"Type": "work"}}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:29.549141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a003fcd2-546b-46fa-9560-68bac0d337f1 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.366470 Jun 30 15:50:29.550118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1155 bytes} [Thu Jun 30 15:50:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3370 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 15:50:29.563335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1e30cb15-7646-4bb1-b03e-96a06913516a tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4c1280>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:29.660341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1e30cb15-7646-4bb1-b03e-96a06913516a tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 200 len: 353 microversion: 2.1 time: 0.101876 Jun 30 15:50:29.661281 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:29 2022] GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:29.792790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6689b592-a63e-40be-b688-f12721ceb1de tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc69d4c0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:29.829489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:29.830685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:29.832046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:29.832860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:50:30.319518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6689b592-a63e-40be-b688-f12721ceb1de tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed3c99cd-2a65-4995-a9ec-6b8e74507ecc" status: 200 len: 351 microversion: 2.1 time: 0.906892 Jun 30 15:50:30.320151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:29 2022] GET /compute/v2.1/os-volumes/ed3c99cd-2a65-4995-a9ec-6b8e74507ecc => generated 351 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:30.673644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6fe91cbf-8a1e-45ff-8e21-926ab5e41822 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4c13a0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:30.778169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6fe91cbf-8a1e-45ff-8e21-926ab5e41822 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 200 len: 354 microversion: 2.1 time: 0.108754 Jun 30 15:50:30.779192 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:30 2022] GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:30.792570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e9d83d62-438a-4a6b-b6b0-821e1b9f2f45 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4ad310>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:30.857678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e9d83d62-438a-4a6b-b6b0-821e1b9f2f45 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 200 len: 354 microversion: 2.1 time: 0.070401 Jun 30 15:50:30.859230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 2/5] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:30 2022] GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:30.877604 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ca8adaa5-dc34-4bde-bf11-f010c8e4f908 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4c19d0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:31.192240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ca8adaa5-dc34-4bde-bf11-f010c8e4f908 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 202 len: 0 microversion: 2.1 time: 0.318854 Jun 30 15:50:31.193495 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 4/6] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 15:50:30 2022] DELETE /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:50:31.204607 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3902c2c9-126b-448d-a715-aa3aab2859d0 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4ad4c0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:31.287528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3902c2c9-126b-448d-a715-aa3aab2859d0 tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 200 len: 353 microversion: 2.1 time: 0.088889 Jun 30 15:50:31.289237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:31 2022] GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:32.156084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6cbaf6ea-f49f-4f0a-98ee-52485ffc32a5 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4cc0d0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:32.246062 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6cbaf6ea-f49f-4f0a-98ee-52485ffc32a5 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d74578dd-3a9f-4ba4-9265-fe9b55bc16b0" status: 200 len: 351 microversion: 2.1 time: 0.094412 Jun 30 15:50:32.247781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:32 2022] GET /compute/v2.1/os-volumes/d74578dd-3a9f-4ba4-9265-fe9b55bc16b0 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:32.301416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-51b3f08c-2b41-4554-b55e-54c1a41cbfbf tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Calling method '.version_select at 0x7fbbdc4adaf0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:32.357731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-51b3f08c-2b41-4554-b55e-54c1a41cbfbf tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] HTTP exception thrown: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-51b3f08c-2b41-4554-b55e-54c1a41cbfbf tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Request method failure captured: Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c HTTP/1.1 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZCDF9ZzRd_TbIQtzBOVjNRWyAQVXUpPnk_bT2NPZb5GjqlbNLlGM2hRSKXwZuvLc9xzqV8vXI2dog9z5lFWB7Voh7vH7Z5VF69h-xthpYjh8U9fpCVhaqHYqHwNLmuTlUqcWQsefgEgE7viO1NtVpDxvi34z8gDAS07IrUnw4StYk Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 5418867eec2d44f6bfe12302db443446 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesGetTestJSON-1538870216 Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:32.363042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5418867eec2d44f6bfe12302db443446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5418867eec2d44f6bfe12302db443446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5418867eec2d44f6bfe12302db443446", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5418867eec2d44f6bfe12302db443446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesGetTestJSON-1538870216 Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 5418867eec2d44f6bfe12302db443446 Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesGetTestJSON-1538870216 Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesGetTestJSON-1538870216-project Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: d56405a1728a4229a128a0b09f4bce83 Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesGetTestJSON-1538870216-project Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '1429d508-b8d4-421c-9172-6b71f94fa89c'} Jun 30 15:50:32.417528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. (HTTP 404) (Request-ID: req-8ecb1253-634d-4439-9ce5-77d5e1f36415) Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:32.418994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 15:50:32.437721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 15:50:32.440399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-51b3f08c-2b41-4554-b55e-54c1a41cbfbf tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] Returning 404 to user: Volume 1429d508-b8d4-421c-9172-6b71f94fa89c could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-51b3f08c-2b41-4554-b55e-54c1a41cbfbf tempest-VolumesGetTestJSON-1538870216 tempest-VolumesGetTestJSON-1538870216-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c" status: 404 len: 109 microversion: 2.1 time: 0.071326 Jun 30 15:50:32.442593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 4/9] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:32 2022] GET /compute/v2.1/os-volumes/1429d508-b8d4-421c-9172-6b71f94fa89c => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:50:33.898648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-43c7bf54-bc24-4271-9348-0a3eca4360f3 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4c1d30>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:34.036738 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-43c7bf54-bc24-4271-9348-0a3eca4360f3 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12208a49-f898-45df-b243-5285a17daee1" status: 200 len: 349 microversion: 2.1 time: 0.141862 Jun 30 15:50:34.037314 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 6/10] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:33 2022] GET /compute/v2.1/os-volumes/12208a49-f898-45df-b243-5285a17daee1 => generated 349 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:34.049785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2263499f-1fb3-4810-a4ab-c3f6a427ef92 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4c4af0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:34.317871 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2263499f-1fb3-4810-a4ab-c3f6a427ef92 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.273015 Jun 30 15:50:34.318452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 5/11] 10.222.0.50 () {58 vars in 1133 bytes} [Thu Jun 30 15:50:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:34.331114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-27d098b5-18e4-44e9-a920-475169de6259 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4c1040>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:34.548572 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-27d098b5-18e4-44e9-a920-475169de6259 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.221370 Jun 30 15:50:34.549168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 7/12] 10.222.0.50 () {58 vars in 1148 bytes} [Thu Jun 30 15:50:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:34.561235 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d82f1b34-1071-4f80-8b87-f61c28c7c348 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc420670>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:34.751704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d82f1b34-1071-4f80-8b87-f61c28c7c348 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.194053 Jun 30 15:50:34.752374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 6/13] 10.222.0.50 () {58 vars in 1133 bytes} [Thu Jun 30 15:50:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:34.763752 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-94426b96-9399-4d80-b6f1-61e827ee3ac6 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4cc790>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:34.887157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-94426b96-9399-4d80-b6f1-61e827ee3ac6 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.127191 Jun 30 15:50:34.894237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 8/14] 10.222.0.50 () {58 vars in 1166 bytes} [Thu Jun 30 15:50:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:34.900578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4e7bce7-2097-4d84-aecc-fa73406c092d tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4c4a60>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:35.106044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a4e7bce7-2097-4d84-aecc-fa73406c092d tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.210281 Jun 30 15:50:35.107532 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1169 bytes} [Thu Jun 30 15:50:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:35.121060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-770f0a84-6e37-48a1-8938-25f89edbc7ed tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4ccdc0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:35.367079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-770f0a84-6e37-48a1-8938-25f89edbc7ed tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.250630 Jun 30 15:50:35.369484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1154 bytes} [Thu Jun 30 15:50:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:35.380090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b38ef95a-652a-45f9-ad6a-f9dc7fd338c6 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc420f70>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:35.555660 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b38ef95a-652a-45f9-ad6a-f9dc7fd338c6 tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179203 Jun 30 15:50:35.556247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 8/17] 10.222.0.50 () {58 vars in 1187 bytes} [Thu Jun 30 15:50:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:35.568376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-66f054b4-5871-4b99-bf0a-6631ad66aecb tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] Calling method '.version_select at 0x7fbbdc4c1310>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:35.738234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-66f054b4-5871-4b99-bf0a-6631ad66aecb tempest-VolumesTestJSON-1443876344 tempest-VolumesTestJSON-1443876344-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.173512 Jun 30 15:50:35.738805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 10/18] 10.222.0.50 () {58 vars in 1154 bytes} [Thu Jun 30 15:50:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:40.019735 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f7291197-dcc6-4eee-bae3-8192e0f0c876 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: .version_select at 0x7fbbdc4c4820>, body: {"keypair": {"name": "tempest-keypair-2127763730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvIJHcsKkYF0lBASzrzjG8BEZuKm6xKER4EctjAO76A5r7AJCzNXuZmrY+B+GDCn0XJqdlGKwfpHml+J8Qh/K11IK7I4vqqExeOP/3LaCl9dNKrRx/gdPaSNwXMtxjL7Q=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:40.075722 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f7291197-dcc6-4eee-bae3-8192e0f0c876 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for project 9874821533c3446c9d71a65fb5b8e703. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:40.083407 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f7291197-dcc6-4eee-bae3-8192e0f0c876 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for user 2f3c67a263b14158a01fd906a31696cd and project 9874821533c3446c9d71a65fb5b8e703. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:40.143509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f7291197-dcc6-4eee-bae3-8192e0f0c876 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314237 Jun 30 15:50:40.144656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 9/19] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:50:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:50:44.769060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1902557822", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffa3f10e-dbc8-4043-9c4c-52b5028d6c41"}], "security_groups": [{"name": "tempest-securitygroup--1765696232"}], "key_name": "tempest-keypair-2127763730", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:45.857398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] validate_networks() for [('ffa3f10e-dbc8-4043-9c4c-52b5028d6c41', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:50:46.340730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1465987390", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "networks": [{"uuid": "673ebdac-1e31-4dcc-a01a-70d809c31f94"}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:46.504212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] validate_networks() for [('673ebdac-1e31-4dcc-a01a-70d809c31f94', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:50:48.526468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:50:48.527453 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:50:48.528529 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:50:48.529085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:50:48.529690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:50:48.569354 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:48.569855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:48.570754 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:48.571779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:48.661620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for project 9874821533c3446c9d71a65fb5b8e703. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:48.680035 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for user 2f3c67a263b14158a01fd906a31696cd and project 9874821533c3446c9d71a65fb5b8e703. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:48.719470 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:50:48.724925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:50:48.846968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:50:48.848079 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:50:48.848736 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:50:48.849709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:50:48.851377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:50:48.870502 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:48.872714 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:48.874429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:48.876380 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:48.924933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-aad9bbff-f373-4588-8526-d1af5d977fc9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.161175 Jun 30 15:50:48.925784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:50:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:50:48.974265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Getting quotas for project 4b65df0cd27d479e9bc39ecb95ff04d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:48.993453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Getting quotas for user ead6569ad30b496092f49b3fe0c8a706 and project 4b65df0cd27d479e9bc39ecb95ff04d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:49.040457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:50:49.044263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:50:49.170578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f3fb9ad7-358e-4b45-97a5-dd8144fe6ff6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.210547 Jun 30 15:50:49.171754 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 10/21] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:50:49.474770 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9204b5f0-fd03-4eef-ac6b-1d711eb5afd2 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Action: 'create', calling method: .version_select at 0x7fbbdc3d8790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1679220264", "metadata": {"Type": "work"}}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9204b5f0-fd03-4eef-ac6b-1d711eb5afd2 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 122 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:50:49.500883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1679220264", "metadata": {"Type": "work"}}} Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: Jun 30 15:50:49.502547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1679220264', 'metadata': {'Type': 'work'}}}} Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise error Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:49.503496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 15:50:49.504984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 15:50:49.506170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 15:50:49.506170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:50:49.506170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9204b5f0-fd03-4eef-ac6b-1d711eb5afd2 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:49.506170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9204b5f0-fd03-4eef-ac6b-1d711eb5afd2 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.576851 Jun 30 15:50:49.511135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 12/22] 10.222.0.50 () {60 vars in 1155 bytes} [Thu Jun 30 15:50:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:50:49.522005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a5ddcc1c-fe8e-48c9-802c-bead68224975 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:49.522514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a5ddcc1c-fe8e-48c9-802c-bead68224975 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:49.688103 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-72364b58-24b7-49ea-b2ba-e3bff1871ba8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: .version_select at 0x7fbbdbb4c670>, body: {"keypair": {"name": "tempest-keypair-578920292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu+zhcZ10BgJ3iCUagAMRnCTVHrdPANDQl7FnxcavVFAHOyGdW0S1zTw/AY3UHdpc+lnYQcfWN5EJxzZ8KhFWpX01zhgo0mWBEPoh1lEjdwQ564d8BBTCYATD43mPbfdQ=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:49.731139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a5ddcc1c-fe8e-48c9-802c-bead68224975 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:49.737452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-72364b58-24b7-49ea-b2ba-e3bff1871ba8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:49.746797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-72364b58-24b7-49ea-b2ba-e3bff1871ba8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for user 7f2f23e763704ce2b0969e24ffde9243 and project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:49.793587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a5ddcc1c-fe8e-48c9-802c-bead68224975 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1238 microversion: 2.1 time: 0.282085 Jun 30 15:50:49.805409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 13/23] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:49 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1238 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:49.809790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-72364b58-24b7-49ea-b2ba-e3bff1871ba8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.635071 Jun 30 15:50:49.810404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 11/24] 10.222.0.50 () {62 vars in 1199 bytes} [Thu Jun 30 15:50:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 638 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 15:50:49.827002 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bd6848de-4fc8-41fd-91bb-c57c6cd03db3 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:49.827635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bd6848de-4fc8-41fd-91bb-c57c6cd03db3 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:49.976552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bd6848de-4fc8-41fd-91bb-c57c6cd03db3 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:50.026281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bd6848de-4fc8-41fd-91bb-c57c6cd03db3 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1215 microversion: 2.1 time: 0.208254 Jun 30 15:50:50.028531 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:49 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:50.044576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68c53adc-ba40-4612-879b-742f18df9f0c tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Action: 'create', calling method: .version_select at 0x7fbbdbb4ce50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1609570418", "metadata": {"Type": "work"}}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68c53adc-ba40-4612-879b-742f18df9f0c tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 120 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:50.073374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1609570418", "metadata": {"Type": "work"}}} Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:50.074681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1609570418', 'metadata': {'Type': 'work'}}}} Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise error Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi '0' Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:50.075488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 15:50:50.076907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 15:50:50.078057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 15:50:50.078057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.081379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68c53adc-ba40-4612-879b-742f18df9f0c tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:50.083551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-68c53adc-ba40-4612-879b-742f18df9f0c tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.050883 Jun 30 15:50:50.087366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 13/26] 10.222.0.50 () {60 vars in 1155 bytes} [Thu Jun 30 15:50:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:50:50.106983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-46e4f487-d481-4393-8714-d3cfae34c26f tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Action: 'create', calling method: .version_select at 0x7fbbdaaf4670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-280241688", "metadata": {"Type": "work"}}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-46e4f487-d481-4393-8714-d3cfae34c26f tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 118 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:50.119759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-280241688", "metadata": {"Type": "work"}}} Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:50.121271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-280241688', 'metadata': {'Type': 'work'}}}} Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise error Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi '' Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:50.121990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 15:50:50.123128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 15:50:50.124936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 15:50:50.124936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.124936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-46e4f487-d481-4393-8714-d3cfae34c26f tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:50.124936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-46e4f487-d481-4393-8714-d3cfae34c26f tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032038 Jun 30 15:50:50.127182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 14/27] 10.222.0.50 () {60 vars in 1155 bytes} [Thu Jun 30 15:50:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:50:50.145779 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-418ef5c4-1c35-4eb9-9f3b-a8b253109ee7 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Calling method '.version_select at 0x7fbbdaa9d310>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:50.223697 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-418ef5c4-1c35-4eb9-9f3b-a8b253109ee7 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] HTTP exception thrown: Volume tempest-invalid-1357196626 could not be found. Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-418ef5c4-1c35-4eb9-9f3b-a8b253109ee7 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1357196626 HTTP/1.1 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:50.226789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Volume tempest-invalid-1357196626 could not be found. Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'tempest-invalid-1357196626'} Jun 30 15:50:50.228350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1357196626 could not be found. (HTTP 404) (Request-ID: req-e7fa253c-df7a-46b6-8c30-4b9a8b889517) Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.229383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 15:50:50.230396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1357196626 could not be found. Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:50:50.232127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1357196626 could not be found. Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1357196626 could not be found. Jun 30 15:50:50.234164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.236864 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-418ef5c4-1c35-4eb9-9f3b-a8b253109ee7 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 404 to user: Volume tempest-invalid-1357196626 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:50.238103 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-418ef5c4-1c35-4eb9-9f3b-a8b253109ee7 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1357196626" status: 404 len: 99 microversion: 2.1 time: 0.105123 Jun 30 15:50:50.240359 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 15/28] 10.222.0.50 () {58 vars in 1217 bytes} [Thu Jun 30 15:50:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1357196626 => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 15:50:50.264034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-40639bc5-61a4-45e3-8f3c-def7819dc6d5 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014662 Jun 30 15:50:50.265540 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 16/29] 10.222.0.50 () {58 vars in 1139 bytes} [Thu Jun 30 15:50:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 15:50:50.281480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-29cfec81-fecb-42a6-bb2c-0453b1e0426d tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009545 Jun 30 15:50:50.285067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 17/30] 10.222.0.50 () {58 vars in 1136 bytes} [Thu Jun 30 15:50:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 15:50:50.298815 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-040fccf1-4d16-4f30-8873-5df3c4eebf68 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Calling method '.version_select at 0x7fbbdaaf4790>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:50.378213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-040fccf1-4d16-4f30-8873-5df3c4eebf68 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] HTTP exception thrown: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-040fccf1-4d16-4f30-8873-5df3c4eebf68 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/os-volumes/c909f653-3d4f-470a-8062-0d25ff15c9d3 HTTP/1.1 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:50.380925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'c909f653-3d4f-470a-8062-0d25ff15c9d3'} Jun 30 15:50:50.382077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. (HTTP 404) (Request-ID: req-582f6800-f138-4e8e-ba26-175dfe067982) Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.382737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 15:50:50.383651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 15:50:50.384827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. Jun 30 15:50:50.385777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.388320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-040fccf1-4d16-4f30-8873-5df3c4eebf68 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 404 to user: Volume c909f653-3d4f-470a-8062-0d25ff15c9d3 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:50.389436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-040fccf1-4d16-4f30-8873-5df3c4eebf68 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/c909f653-3d4f-470a-8062-0d25ff15c9d3" status: 404 len: 109 microversion: 2.1 time: 0.098386 Jun 30 15:50:50.390498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 18/31] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 15:50:50 2022] DELETE /compute/v2.1/os-volumes/c909f653-3d4f-470a-8062-0d25ff15c9d3 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:50:50.411162 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6be3d904-ad08-42a4-af98-f4252e46b7b3 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Calling method '.version_select at 0x7fbbdaa9f700>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:50.483654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-6be3d904-ad08-42a4-af98-f4252e46b7b3 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] HTTP exception thrown: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6be3d904-ad08-42a4-af98-f4252e46b7b3 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Request method failure captured: Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/os-volumes/7b8e89d0-0896-4be9-8867-3f3677d1a534 HTTP/1.1 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZWhwt1yY5UVUCky6V-VMBCBp4ZtYgjzcujK8TpLxUFxxuJcL3uvI7k_hWwCQxMWi7molZtPdTWniH35Ye-lLy9yhZByASrIETL8NEj98f4iuzePCUuq2LO1ISA7L4ezmfx8gzttcI1ACKuatz7hNeYygL_k1ZjY4nACMt2-nls0hI Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:50:50.485930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4a50129ee95f42dda024fecff91547c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4a50129ee95f42dda024fecff91547c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 4a50129ee95f42dda024fecff91547c1 Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesNegativeTest-566273028 Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: a3519b4e556e416b8e78ce28a830cc99 Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesNegativeTest-566273028-project Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '7b8e89d0-0896-4be9-8867-3f3677d1a534'} Jun 30 15:50:50.487236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. (HTTP 404) (Request-ID: req-90ed257b-465e-4ae3-8e26-58991c06c6f6) Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.488088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 15:50:50.489802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 15:50:50.491716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6be3d904-ad08-42a4-af98-f4252e46b7b3 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] Returning 404 to user: Volume 7b8e89d0-0896-4be9-8867-3f3677d1a534 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6be3d904-ad08-42a4-af98-f4252e46b7b3 tempest-VolumesNegativeTest-566273028 tempest-VolumesNegativeTest-566273028-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7b8e89d0-0896-4be9-8867-3f3677d1a534" status: 404 len: 109 microversion: 2.1 time: 0.092262 Jun 30 15:50:50.492914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 19/32] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 15:50:50 2022] GET /compute/v2.1/os-volumes/7b8e89d0-0896-4be9-8867-3f3677d1a534 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:50:50.704217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2023683242", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:50.813214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e1ad7b45-fbc2-414c-b7be-f71d26e45153 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:50.814044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e1ad7b45-fbc2-414c-b7be-f71d26e45153 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:50.845427 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] validate_networks() for [('f1b0598a-0f3d-45a8-b226-13dfd84b67db', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:50:51.346362 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e1ad7b45-fbc2-414c-b7be-f71d26e45153 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:51.360733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e1ad7b45-fbc2-414c-b7be-f71d26e45153 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1238 microversion: 2.1 time: 0.550289 Jun 30 15:50:51.362511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 20/33] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:50 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1238 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:51.381203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5666f2f6-8586-49fe-8f30-a45a202ccd09 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:51.386808 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5666f2f6-8586-49fe-8f30-a45a202ccd09 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:51.677447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5666f2f6-8586-49fe-8f30-a45a202ccd09 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:51.700863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5666f2f6-8586-49fe-8f30-a45a202ccd09 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1215 microversion: 2.1 time: 0.337061 Jun 30 15:50:51.701514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 21/34] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:51 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:52.158974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:50:52.159535 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:50:52.160189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:50:52.160611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:50:52.161028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:50:52.177371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:52.178282 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:52.180574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:52.183132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:52.226255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:52.236556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for user d30ffdb0374c4600a09476cfb3a07cb4 and project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:52.263461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:50:52.267358 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:50:52.379532 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:52.380433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:52.397046 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-87626727-af16-492c-8c00-660f482f9512 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.588308 Jun 30 15:50:52.398582 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:52.401197 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 14/35] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:50:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:50:52.401521 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:52.402779 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:52.403422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:52.418768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d17f7f2c-f4d5-480c-953d-ca2b63829fb5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:52.420811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d17f7f2c-f4d5-480c-953d-ca2b63829fb5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:52.922141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d17f7f2c-f4d5-480c-953d-ca2b63829fb5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:52.936557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d17f7f2c-f4d5-480c-953d-ca2b63829fb5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1222 microversion: 2.1 time: 0.528907 Jun 30 15:50:52.954119 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 15/36] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:52 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1222 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:52.983884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:52.990524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:53.018234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:53.019374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:53.020315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:53.024286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:53.089056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:53.168491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9db9b0ea-2dc3-4866-851a-2f78c94a54df tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1290 microversion: 2.1 time: 0.789434 Jun 30 15:50:53.173072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 22/37] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:52 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1290 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:53.455772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1231627215", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:53.690941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] validate_networks() for [('f1b0598a-0f3d-45a8-b226-13dfd84b67db', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:50:55.262797 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:55.292704 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e8398f28-e35d-435e-808c-70f5407c88fc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1275 microversion: 2.1 time: 2.321429 Jun 30 15:50:55.304270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 16/38] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:52 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1275 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:55.311165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:55.314889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:55.327409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:55.328081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:55.328921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:55.329367 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:56.315814 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:56.343974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f881a518-b397-4048-aff6-0810efc64871 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1296 microversion: 2.1 time: 1.045496 Jun 30 15:50:56.346101 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 17/39] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:55 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1296 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:56.366918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1554329535", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b601c7e-ccdb-42e6-964c-f43a3e4438dc"}], "security_groups": [{"name": "tempest-securitygroup--1334197396"}], "key_name": "tempest-keypair-578920292", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:50:57.279874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] validate_networks() for [('0b601c7e-ccdb-42e6-964c-f43a3e4438dc', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:50:58.300223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:50:58.304978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:50:58.304978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:50:58.304978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:50:58.304978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:50:58.318894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.322124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:58.324836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.325258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:58.404308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:58.433688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for user d30ffdb0374c4600a09476cfb3a07cb4 and project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:58.467975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:50:58.470588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:50:58.598449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e78c0dd9-a2a9-4ba0-ac20-019aacde76e2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.158719 Jun 30 15:50:58.599535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 23/40] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:50:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 5161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:50:58.606288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:58.611067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:58.630368 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.631013 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:58.632230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.632713 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:58.761310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:58.772314 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-98995e6a-39fd-477b-b322-156cbf2030bc tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1273 microversion: 2.1 time: 0.168759 Jun 30 15:50:58.774011 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 24/41] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:58 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:58.786144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:58.799731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:58.825532 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.826024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:58.826809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:58.829830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.452590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:59.475336 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dbe9b4e6-df19-4475-b7ba-b3eff34c736d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.699529 Jun 30 15:50:59.476557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 25/42] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:58 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:59.493729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:50:59.494374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:50:59.495152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:50:59.495896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:50:59.496360 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:50:59.502476 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:59.503294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:59.527041 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.527741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.538989 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.544433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.546865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.549981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.552303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.554837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.657730 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:50:59.677294 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for user 7f2f23e763704ce2b0969e24ffde9243 and project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:50:59.738927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:50:59.762618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:50:59.785087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:50:59.796130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c49a6f20-38d5-44cc-ae61-b6f650977588 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1226 microversion: 2.1 time: 0.316550 Jun 30 15:50:59.801064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 26/43] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:59 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1226 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:50:59.808552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:50:59.810078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:50:59.817713 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.818364 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.819802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:50:59.820715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:50:59.996750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-91ebf8e3-c2ef-4504-82ac-3d231583ac60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.644810 Jun 30 15:51:00.004867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 18/44] 10.222.0.50 () {62 vars in 1187 bytes} [Thu Jun 30 15:50:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 15:51:00.019099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:00.020976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:00.153507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:00.175594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:00.182779 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-81f7dadf-c586-4aa5-b71e-8b46dca53c86 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.365742 Jun 30 15:51:00.185851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 27/45] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:50:59 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:00.188925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:00.190882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:00.193067 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8b0abe2b-7548-483c-83b4-95036a4f2f5b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1281 microversion: 2.20 time: 0.181278 Jun 30 15:51:00.194420 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 19/46] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:00 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:00.493547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:00.494827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:00.513265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:00.514639 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:00.516768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:00.519584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:00.833226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:00.833869 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:00.851308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:00.851769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:00.852579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:00.853014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:00.974001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.025213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c867cf38-dcd8-4390-a7a4-5986bc570d75 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.529686 Jun 30 15:51:01.025890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 28/47] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:00 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:01.175299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.188580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-78d082cc-815e-41ad-bce8-20c21d352d6f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1274 microversion: 2.1 time: 0.372848 Jun 30 15:51:01.191394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 20/48] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:00 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1274 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:01.209200 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:01.211680 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:01.216333 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:01.217598 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:01.229929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:01.230369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:01.234088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:01.234735 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:01.235103 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:01.235894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:01.237455 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:01.239440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:01.405734 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.421112 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.434269 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.436436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-24fd1fed-b7ab-4d1d-a89b-4f205f12e6cf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1277 microversion: 2.20 time: 0.225230 Jun 30 15:51:01.438581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 21/49] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:01 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:01.925785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:01.937734 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-aaf05f63-f485-45a7-9756-4ea8b8107c0e tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.739354 Jun 30 15:51:01.947342 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 29/50] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:01 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:02.043497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:02.044157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:02.054707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.069224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.071810 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.077523 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.208934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:02.210593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:02.224984 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.225662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.226481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.227085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.576030 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:02.587005 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0bce1de2-e5c0-48f4-abb5-3b3e36a8e048 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1274 microversion: 2.1 time: 0.382867 Jun 30 15:51:02.587840 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 30/51] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:02 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1274 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:02.595974 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:02.602490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:02.613208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.614043 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.621600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:02.622209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:02.967101 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:02.991773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:02.994124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:02.995539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-abea803b-47cb-4038-9cdd-b7d6145e2036 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1277 microversion: 2.20 time: 0.406575 Jun 30 15:51:02.996619 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 31/52] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:02 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1277 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:03.001584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:03.007014 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:03.019478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:03.020138 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:03.021047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:03.021618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:03.782466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:03.790974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-069c81c8-debe-413d-a87a-c76a9a71c672 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 1.751898 Jun 30 15:51:03.794759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 22/53] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:02 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:03.959676 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-4adf2e93-569b-4c89-9cdc-81dad6eba095 req-4f681457-109d-4e3d-9c3c-918555ebfba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c", "tag": "8ba5991f-fae8-42bd-a8de-ede01c27a8f7"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:04.002837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-4adf2e93-569b-4c89-9cdc-81dad6eba095 req-4f681457-109d-4e3d-9c3c-918555ebfba4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.003406 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-4adf2e93-569b-4c89-9cdc-81dad6eba095 req-4f681457-109d-4e3d-9c3c-918555ebfba4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.051353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:04.065590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c32857a7-5dd2-48bb-964c-ee21694e07cf tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 1.067679 Jun 30 15:51:04.080568 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 32/54] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:02 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:04.093118 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:04.093719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:04.099848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-4adf2e93-569b-4c89-9cdc-81dad6eba095 req-4f681457-109d-4e3d-9c3c-918555ebfba4 service nova] Creating event network-changed:8ba5991f-fae8-42bd-a8de-ede01c27a8f7 for instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c on hv-cinder-79760 Jun 30 15:51:04.105655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.107762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.109456 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.112425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-4adf2e93-569b-4c89-9cdc-81dad6eba095 req-4f681457-109d-4e3d-9c3c-918555ebfba4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 15:51:04.113142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.113707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.114164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.122604 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.123433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.150917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.compute.rpcapi [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 15:51:04.153556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] Releasing lock "compute-rpcapi-router" {{(pid=129450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 15:51:04.196679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-865e740f-ad19-483c-98ed-7fbd7f21f1fe None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.400296 Jun 30 15:51:04.197647 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 23/55] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:04.208405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:04.209100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:04.219847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.228961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.230464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.231002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.355378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:04.364956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b74921ba-f0ba-42ca-a267-6419a851cbc7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1274 microversion: 2.1 time: 0.283103 Jun 30 15:51:04.366691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 33/56] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:04 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:04.442809 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:04.454918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:04.457394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:04.462005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9e6aa0c7-9126-4207-8d3d-42a881d8bc59 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1277 microversion: 2.20 time: 0.263192 Jun 30 15:51:04.465916 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 24/57] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:04 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:04.820209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:04.822207 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:04.848040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.849019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:04.852879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:04.853929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.083376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:05.084727 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:05.095955 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.104174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.105232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.105812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.406885 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:05.426145 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8e3dd855-2b04-4328-8868-829e75403f59 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.620713 Jun 30 15:51:05.428285 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 34/58] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:04 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:05.433920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:05.450321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:05.464559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.467136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.468885 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.470920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.804757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:05.815624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5567d840-0c57-44d6-9681-816cd0a953ae tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1274 microversion: 2.1 time: 0.384941 Jun 30 15:51:05.817533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 35/59] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:05 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1274 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:05.833029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:05.834800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:05.869837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.870415 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.871409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:05.872915 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:05.922857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:05.950884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b7cd7e12-5d15-4434-87dd-f843b4d73a14 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.872084 Jun 30 15:51:05.952847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 25/60] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:05 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:06.108557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:06.125133 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:06.142138 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:06.144705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7d62ccb4-6b04-4647-b16e-f0aa197c25b7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1277 microversion: 2.20 time: 0.325065 Jun 30 15:51:06.145724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 36/61] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:05 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:06.239711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-d5493854-6963-4641-bb86-7337adaf7ef6 req-3d33e6e1-19d3-42c2-b462-8263b1d69559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85185f0-6858-4750-a044-9c3dc44d0240", "tag": "b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:06.273831 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d5493854-6963-4641-bb86-7337adaf7ef6 req-3d33e6e1-19d3-42c2-b462-8263b1d69559 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:06.274726 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d5493854-6963-4641-bb86-7337adaf7ef6 req-3d33e6e1-19d3-42c2-b462-8263b1d69559 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:06.329711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-d5493854-6963-4641-bb86-7337adaf7ef6 req-3d33e6e1-19d3-42c2-b462-8263b1d69559 service nova] Creating event network-changed:b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8 for instance b85185f0-6858-4750-a044-9c3dc44d0240 on hv-cinder-79760 Jun 30 15:51:06.343656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-d5493854-6963-4641-bb86-7337adaf7ef6 req-3d33e6e1-19d3-42c2-b462-8263b1d69559 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389447 Jun 30 15:51:06.347745 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 26/62] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:06.445603 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:06.446389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:06.457835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:06.459808 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:06.462265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:06.462794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:06.837216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:06.838153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:06.856621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:06.858340 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:06.861424 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:06.861911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:07.190120 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:07.201996 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a88dae25-d4cb-46d5-9d35-b1ef9686c1b1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1280 microversion: 2.1 time: 0.370431 Jun 30 15:51:07.208759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 27/63] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:06 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1280 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:07.217793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:07.218411 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:07.257785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:07.258435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:07.259011 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:07.259456 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:07.547587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:07.558687 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dfee1032-203c-4b75-adb3-71780e459db6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 1.118328 Jun 30 15:51:07.559270 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 37/64] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:06 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:07.580930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:07.581709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:07.588218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:07.590496 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:07.591374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:07.592382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:07.592959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:07.993842 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:07.999021 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:08.016659 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:08.023606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:08.024925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-04a08b1c-5f1e-4a78-8926-3e491ea47ab7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1339 microversion: 2.20 time: 0.455099 Jun 30 15:51:08.027385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 38/65] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:07 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1339 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:08.107056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:08.116084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a9ec4fd8-9ea1-43f0-b8ad-a1338a3a8353 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.904853 Jun 30 15:51:08.132074 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 28/66] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:07 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:08.228070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:08.228985 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:08.238621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:08.239649 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:08.241664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:08.242428 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:08.354939 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:08.362729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-98450f31-ee95-4b87-8d0c-b613c3a5c1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1280 microversion: 2.1 time: 0.140525 Jun 30 15:51:08.369404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 39/67] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:08 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:08.378212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-400069d3-6cc8-45bf-b233-785bcc770d7d req-380132b7-32c0-47ad-a8fd-29df00c4d028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4019fc09-23bd-4909-9804-4c685e180031", "tag": "938d07f0-00dc-4473-ad00-fcf65c20baa9"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:08.391792 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-400069d3-6cc8-45bf-b233-785bcc770d7d req-380132b7-32c0-47ad-a8fd-29df00c4d028 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:08.392263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-400069d3-6cc8-45bf-b233-785bcc770d7d req-380132b7-32c0-47ad-a8fd-29df00c4d028 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:08.417626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-400069d3-6cc8-45bf-b233-785bcc770d7d req-380132b7-32c0-47ad-a8fd-29df00c4d028 service nova] Creating event network-changed:938d07f0-00dc-4473-ad00-fcf65c20baa9 for instance 4019fc09-23bd-4909-9804-4c685e180031 on hv-cinder-79760 Jun 30 15:51:08.431147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-400069d3-6cc8-45bf-b233-785bcc770d7d req-380132b7-32c0-47ad-a8fd-29df00c4d028 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056793 Jun 30 15:51:08.432065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 29/68] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:08.575288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:08.576155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:08.581559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=4 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:08.582325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=26 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:08.584154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:08.585375 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:08.585885 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:08.592527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:08.725537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:08.733695 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fa50c0eb-8d40-4441-9da5-3845cb7bd543 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.162350 Jun 30 15:51:08.734263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 40/69] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:08 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:09.044963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:09.045814 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:09.052138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.052580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.053345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.053778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.126300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.135201 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.137193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.138735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-243f64a6-5c86-4e64-9277-cb2271ae33eb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1339 microversion: 2.20 time: 0.098201 Jun 30 15:51:09.138863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:09.139363 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 30/70] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:09 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:09.139478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:09.145623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.146052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.146798 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.147404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.279621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.288642 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-49bbaba4-e115-4323-b3ad-2209b093c121 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.153690 Jun 30 15:51:09.289199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 41/71] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:09 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:09.385174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:09.385788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:09.392029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.392504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.393266 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.393701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.585878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.594317 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e9a70027-9401-4ced-9f57-e5ff78af2daa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.212939 Jun 30 15:51:09.595291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 31/72] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:09 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:09.753847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:09.755956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:09.764031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.764634 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.765668 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:09.766314 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:09.934418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:09.943951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-68cfdcb5-3582-47d3-8191-5714791b5ac1 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.195111 Jun 30 15:51:09.944567 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 42/73] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:09 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:10.158584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:10.159295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:10.166452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.166923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.167676 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.168109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.183383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=24 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:10.261813 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:10.270765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:10.279602 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:10.285942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3590d103-7ab1-4fa7-a093-0d0aa5b29465 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1339 microversion: 2.20 time: 0.130656 Jun 30 15:51:10.287290 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 32/74] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:10 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:10.305870 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:10.306507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:10.312775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.313210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.313959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.314390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.461006 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:10.469014 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-344e90aa-38f9-4407-95e0-614b98b428c1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.167140 Jun 30 15:51:10.469576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 43/75] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:10 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:10.611392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:10.612033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:10.618929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.619373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.620169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:10.620600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:10.780064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:10.789275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5bb7b930-c00f-423c-b3a2-9dbfa0d7b94c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.181353 Jun 30 15:51:10.790250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 33/76] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:10 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:10.968733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:10.970709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:11.003221 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.004251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.018264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.022853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.304858 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:11.305474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:11.316493 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.317236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.318160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.318743 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.450990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:11.460263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:11.464677 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:11.465676 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:11.468671 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7aac0ce5-20f7-4be9-b190-b613f66a7c7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1339 microversion: 2.20 time: 0.168025 Jun 30 15:51:11.472728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 34/77] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:11 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:11.483690 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f08273a7-680d-4652-92bd-ba14d2b64a2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.509747 Jun 30 15:51:11.484556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 44/78] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:10 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:11.486901 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:11.487518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:11.490968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:11.497006 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.497536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.498316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.498760 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.507027 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:11.760081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:11.774468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fe01e6f4-faf3-4247-b835-b26328932f6f tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.292436 Jun 30 15:51:11.776161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 35/79] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:11 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:11.806772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:11.807626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:11.821545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.822273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:11.829248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:11.832757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:12.096433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-bcf523fc-3b7a-4f69-982b-9a415eda37bf req-fbb00183-a7bd-4add-bb7a-2f761ea04f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0650698c-ce72-4d65-bb06-23af0543521a", "tag": "b419bf3d-cf4e-43db-962c-8fe5a23deadb"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:12.125068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-bcf523fc-3b7a-4f69-982b-9a415eda37bf req-fbb00183-a7bd-4add-bb7a-2f761ea04f27 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:12.129371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-bcf523fc-3b7a-4f69-982b-9a415eda37bf req-fbb00183-a7bd-4add-bb7a-2f761ea04f27 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:12.167944 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-bcf523fc-3b7a-4f69-982b-9a415eda37bf req-fbb00183-a7bd-4add-bb7a-2f761ea04f27 service nova] Creating event network-changed:b419bf3d-cf4e-43db-962c-8fe5a23deadb for instance 0650698c-ce72-4d65-bb06-23af0543521a on hv-cinder-79760 Jun 30 15:51:12.181398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-bcf523fc-3b7a-4f69-982b-9a415eda37bf req-fbb00183-a7bd-4add-bb7a-2f761ea04f27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097744 Jun 30 15:51:12.184348 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 36/80] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:51:12.238692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:12.253020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-39ba46fa-7092-4639-8569-434478b0d9f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.449697 Jun 30 15:51:12.255135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 45/81] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:11 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:12.492532 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:12.493284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:12.501327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:12.502169 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:12.508378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:12.508828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:12.509595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:12.510825 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:12.511743 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:12.514290 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:12.515689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:12.516663 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:13.362438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:13.373567 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7c39e068-6502-4648-bcee-2c812ac61fc7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.876219 Jun 30 15:51:13.377783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 46/82] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:12 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:13.382704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:13.393078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:13.399634 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:13.400127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:13.400907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:13.401333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:13.557731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:13.579846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:13.581779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:13.584808 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-18285e6f-419a-40b2-bff3-af168b5b608c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 1.097242 Jun 30 15:51:13.592292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 37/83] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:12 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:13.601557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:13.602340 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:13.624380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:13.625307 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:13.627736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:13.629260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:14.108665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:14.119281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3482a8b9-6f99-43a9-b402-7786362f14d1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.739808 Jun 30 15:51:14.121171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 47/84] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:13 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:14.145520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=8 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:14.182263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:14.193814 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-91764512-45dd-4c1b-9685-855a5f800b79 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.600014 Jun 30 15:51:14.195356 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 38/85] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:13 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:14.394569 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:14.395174 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:14.401440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:14.401886 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:14.402629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:14.403291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:14.613383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:14.614135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:14.623982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:14.624536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:14.625678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:14.626427 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:14.906149 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:14.919291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6d2065c3-02bf-4ad3-b5ed-a0a7eed0f473 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.526362 Jun 30 15:51:14.921190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 48/86] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:14 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:15.004372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:15.016423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:15.019013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:15.025845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-64ce0a27-a18f-461b-97d2-e1a2f4c9c652 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.420163 Jun 30 15:51:15.026620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 39/87] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:14 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:15.136258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:15.136814 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:15.144610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.145062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.145805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.146227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.196392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-7cdef917-0568-4a58-bdaa-bf85d22d5092 req-1a258c0f-aec2-4771-9241-a4d9feda4ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:15.218840 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-7cdef917-0568-4a58-bdaa-bf85d22d5092 req-1a258c0f-aec2-4771-9241-a4d9feda4ec8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.219479 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-7cdef917-0568-4a58-bdaa-bf85d22d5092 req-1a258c0f-aec2-4771-9241-a4d9feda4ec8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.234610 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-7cdef917-0568-4a58-bdaa-bf85d22d5092 req-1a258c0f-aec2-4771-9241-a4d9feda4ec8 service nova] Creating event network-changed:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:51:15.244554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-7cdef917-0568-4a58-bdaa-bf85d22d5092 req-1a258c0f-aec2-4771-9241-a4d9feda4ec8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052292 Jun 30 15:51:15.245689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 40/88] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:15.252329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:15.253498 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:15.271135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.272099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.272376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.276607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.458435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:15.466366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2a2b2aa0-72c1-4fb9-9dd7-6a5ecc902a96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.333813 Jun 30 15:51:15.467274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 49/89] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:15 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:15.504109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:15.511891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5fb01591-d294-4d2b-b07f-cea8c2b48926 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.264924 Jun 30 15:51:15.522540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 41/90] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:15 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:15.937261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:15.937888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:15.943885 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.944369 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:15.945136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:15.945557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.045883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:16.046514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:16.057149 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.069261 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.070257 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.070786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.124979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.136246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f14f9d45-2a6c-442a-ab63-455b0837ea92 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.202684 Jun 30 15:51:16.140134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 50/91] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:15 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:16.237133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.248941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.250824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.252309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-657f2449-264f-40ba-9c49-9e9ead84d33c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.210522 Jun 30 15:51:16.252929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 42/92] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:16 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:16.482524 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:16.483756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:16.490893 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.491580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.492692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.493420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.531331 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:16.532050 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:16.541009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.541657 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.543042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:16.544698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:16.796877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.815246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e46afb56-dd75-4fd1-bb1c-1b884b650dc5 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.334461 Jun 30 15:51:16.816984 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 51/93] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:16 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:16.834107 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:16.844499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0a5aeab6-eec0-4f5a-9358-dc7ea05d7ec6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.318162 Jun 30 15:51:16.845637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 43/94] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:16 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:17.159909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:17.159909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:17.165440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.166093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.167169 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.167602 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.272634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:17.276346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:17.286137 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.289364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.290371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.291210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.431600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:17.441589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9f35e6a6-10d1-461f-8c42-dbf4cfe64927 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.290488 Jun 30 15:51:17.442851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 52/95] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:17 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:17.612117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:17.629805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:17.631541 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:17.632688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-694bc2d1-e821-4b1b-922d-020266165362 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.364078 Jun 30 15:51:17.643862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 44/96] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:17 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:17.834083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:17.835551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:17.842537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.843225 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.844249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.845374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.862040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:17.863016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:17.878609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.882571 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:17.884118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:17.887302 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:18.450446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.454573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.461739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b2a50bac-f39a-41da-b0c6-05a1d5f5959e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.603675 Jun 30 15:51:18.462267 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9df1c793-a365-4e6c-a588-1d28ac1486c6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.632264 Jun 30 15:51:18.462847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 53/97] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:17 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:18.463458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 45/98] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:17 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:18.486082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:18.487016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:18.494657 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:18.495237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:18.496226 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:18.496901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:18.651105 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:18.651843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:18.659321 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:18.664581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:18.665566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:18.666281 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:18.856259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.867499 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8129fc96-6cae-4977-9922-f0e917fd82a2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.402121 Jun 30 15:51:18.867499 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 54/99] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:18 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:18.965860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.974686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.976232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:18.977425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9dd98fa7-f8d0-48eb-89de-6fa744ba74ca tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.330398 Jun 30 15:51:18.978176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 46/100] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:18 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:19.481255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:19.482964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:19.486878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:19.487637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:19.492696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.494508 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.495482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.496233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.505188 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.506438 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.508968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.510317 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.523699 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:19.750259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:19.753640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:19.757956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-745aa45d-f678-4d4d-9bf2-f6649e09215d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.282185 Jun 30 15:51:19.759711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 55/101] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:19 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:19.769434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be8edece-40e5-47a1-a9b1-e6d4dbf0fa44 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.287761 Jun 30 15:51:19.770491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 47/102] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:19 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:19.884036 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:19.885595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:19.893875 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.895260 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.896578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:19.897152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:19.998939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:19.999807 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:20.011590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.012305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:20.013654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.014418 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:20.056552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:20.067716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-448bc4df-e61f-42c3-89ce-37c7c98f14a3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.185892 Jun 30 15:51:20.069053 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 56/103] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:19 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:20.204071 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:20.220170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:20.222243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:20.223591 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4c96c605-ee25-4ab3-a377-00efc318c167 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.230155 Jun 30 15:51:20.224422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 48/104] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:19 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:20.774565 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:20.775176 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:20.786719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:20.787407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:20.793905 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.795479 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:20.797936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.798349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.798981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:20.799599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:20.801444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:20.804049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.084594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.086445 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.094713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-393720a3-0849-422b-b115-838b0ba8e0fb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.311938 Jun 30 15:51:21.096147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 49/105] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:20 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:21.099838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:21.100481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:21.106577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.106965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-be3e0b15-bc7b-44e8-8b03-6e2bdd911c3d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.335417 Jun 30 15:51:21.107583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.108674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.109156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.114901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 57/106] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:20 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:21.323534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.333312 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1534680b-96f2-442f-9aff-fa1a9e428476 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.236871 Jun 30 15:51:21.333997 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 50/107] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:21 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:21.348324 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:21.349555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:21.363657 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.364144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.364929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.365832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.384437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-36738c04-c28f-4f31-800c-2175782d5239 req-ab6de666-0d41-485c-86b3-c7c4aa2c6a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4019fc09-23bd-4909-9804-4c685e180031", "name": "network-vif-plugged", "status": "completed", "tag": "938d07f0-00dc-4473-ad00-fcf65c20baa9"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:21.397977 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-36738c04-c28f-4f31-800c-2175782d5239 req-ab6de666-0d41-485c-86b3-c7c4aa2c6a82 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.398421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-36738c04-c28f-4f31-800c-2175782d5239 req-ab6de666-0d41-485c-86b3-c7c4aa2c6a82 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.421277 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-36738c04-c28f-4f31-800c-2175782d5239 req-ab6de666-0d41-485c-86b3-c7c4aa2c6a82 service nova] Creating event network-vif-plugged:938d07f0-00dc-4473-ad00-fcf65c20baa9 for instance 4019fc09-23bd-4909-9804-4c685e180031 on hv-cinder-79760 Jun 30 15:51:21.421813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-36738c04-c28f-4f31-800c-2175782d5239 req-ab6de666-0d41-485c-86b3-c7c4aa2c6a82 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 15:51:21.422952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.423387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.424354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:21.424961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:21.434367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.compute.rpcapi [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 15:51:21.435543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] Releasing lock "compute-rpcapi-router" {{(pid=129449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 15:51:21.456415 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7752ac6f-56f7-4dc7-b61f-a6b10ec45ed6 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291486 Jun 30 15:51:21.457749 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 58/108] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:51:21.523019 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.532358 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.533948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:21.535073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-26a66e13-8caf-4a61-b3d8-ef4df0e66050 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.200083 Jun 30 15:51:21.535631 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 51/109] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:21 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:22.111328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:22.112707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:22.123009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.123453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.124469 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.125045 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.125662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:22.126763 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:22.134933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.135742 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.136945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.137571 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.341841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.342036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.357425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b71afbb3-16b3-4d31-99d3-d42f69f54ba0 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.235700 Jun 30 15:51:22.358474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ec7c99f2-4be5-4e07-afa6-e73d18725f9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.249083 Jun 30 15:51:22.359135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 52/110] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:22 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:22.360766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 59/111] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:22 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:22.364727 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:22.366194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:22.372854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.373405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.374517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.375076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.379344 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:22.541457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.552341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:22.553305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:22.564892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.567477 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.568578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:22.569224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:22.569484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be53cfc7-80d8-4e81-b930-b469fcabc581 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.208989 Jun 30 15:51:22.584462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 53/112] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:22 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:22.884574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.893876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.896285 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:22.897965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-736f47ab-bd3c-4f1b-995e-5b0b705b5656 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.349767 Jun 30 15:51:22.898778 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 60/113] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:22 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:23.375167 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:23.376402 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:23.378570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:23.379308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:23.382906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.383356 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.384164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.384581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.386167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.386721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.387595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.388141 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.636531 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:23.644953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c3421ee5-4902-41c1-b85c-b84042538f7c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.270380 Jun 30 15:51:23.645274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:23.654880 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 61/114] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:23 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:23.659218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-abf034ef-b9ea-4462-a087-5f52012baadd tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.286833 Jun 30 15:51:23.659457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-8695ca05-9b42-4fd5-9fe6-c08f2fd38e7b req-a68ce199-02b7-41f7-9e15-327f2d68dbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85185f0-6858-4750-a044-9c3dc44d0240", "name": "network-vif-plugged", "status": "completed", "tag": "b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:23.661139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 54/115] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:23 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:23.668337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-8695ca05-9b42-4fd5-9fe6-c08f2fd38e7b req-a68ce199-02b7-41f7-9e15-327f2d68dbb2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.668835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-8695ca05-9b42-4fd5-9fe6-c08f2fd38e7b req-a68ce199-02b7-41f7-9e15-327f2d68dbb2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.673284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:23.674954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:23.680936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-8695ca05-9b42-4fd5-9fe6-c08f2fd38e7b req-a68ce199-02b7-41f7-9e15-327f2d68dbb2 service nova] Creating event network-vif-plugged:b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8 for instance b85185f0-6858-4750-a044-9c3dc44d0240 on hv-cinder-79760 Jun 30 15:51:23.686555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.686703 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-8695ca05-9b42-4fd5-9fe6-c08f2fd38e7b req-a68ce199-02b7-41f7-9e15-327f2d68dbb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039848 Jun 30 15:51:23.687138 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 62/116] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:23.687502 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.688428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.690212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.881023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:23.890033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8df65ed9-4659-42ad-b43b-2b1d2e2081ef tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.227733 Jun 30 15:51:23.890642 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 55/117] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:23 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:23.919523 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:23.920663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:23.928193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.930685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:23.932542 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:23.933206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.086412 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:24.096439 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:24.098435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:24.099573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6d46a1b5-234f-40d0-93b7-eb26ce80aa0c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.184329 Jun 30 15:51:24.100858 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 63/118] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:23 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:24.663595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:24.664422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:24.670969 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.671417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.672213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.672645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.677946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:24.679082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:24.686301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.686889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.688419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.688827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.863115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:24.871016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e5208d69-5e87-4a9a-8f13-ea693bb32021 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.212619 Jun 30 15:51:24.871577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 56/119] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:24 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:24.891281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:24.898736 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2abf268f-579a-4b6e-b444-f2be5481b966 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.224972 Jun 30 15:51:24.899227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 64/120] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:24 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:24.912743 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:24.913387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:24.921761 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.922315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:24.923173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:24.923632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.061033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:25.068864 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5aea5e68-c16d-4a35-bbe3-e335bb800e7e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.160176 Jun 30 15:51:25.069426 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 57/121] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:24 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:25.119178 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:25.119692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:25.126003 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.126558 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.127421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.127920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.255786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:25.264513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:25.266191 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:25.267252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5caaee91-4f85-45b2-9117-75ca1cb1b30b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.152550 Jun 30 15:51:25.267797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 65/122] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:25 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:25.703102 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-ee7ed7a8-fabf-42dd-bcef-3a3a7be0df42 req-9654cea1-c0db-4c9a-b66a-1831596cf7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c", "name": "network-vif-plugged", "status": "completed", "tag": "8ba5991f-fae8-42bd-a8de-ede01c27a8f7"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:25.712278 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ee7ed7a8-fabf-42dd-bcef-3a3a7be0df42 req-9654cea1-c0db-4c9a-b66a-1831596cf7ed service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.712993 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ee7ed7a8-fabf-42dd-bcef-3a3a7be0df42 req-9654cea1-c0db-4c9a-b66a-1831596cf7ed service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.724900 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-ee7ed7a8-fabf-42dd-bcef-3a3a7be0df42 req-9654cea1-c0db-4c9a-b66a-1831596cf7ed service nova] Creating event network-vif-plugged:8ba5991f-fae8-42bd-a8de-ede01c27a8f7 for instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c on hv-cinder-79760 Jun 30 15:51:25.730048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-ee7ed7a8-fabf-42dd-bcef-3a3a7be0df42 req-9654cea1-c0db-4c9a-b66a-1831596cf7ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032977 Jun 30 15:51:25.730822 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 58/123] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:51:25.887315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:25.889867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:25.897106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.897638 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.898308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.898832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.925272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:25.927773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:25.937945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.938451 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:25.939334 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:25.940133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:26.107330 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.118865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-174ef95c-fc3e-4de3-911e-43bbbe8b7e51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.235871 Jun 30 15:51:26.119662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 66/124] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:25 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:26.125828 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:26.126462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:26.144706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:26.147924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:26.148785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:26.149250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:26.151016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.162377 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ecd54e33-5d00-4f16-9d4a-b825c38c5e6c tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.246470 Jun 30 15:51:26.162957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 59/125] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:25 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:26.289865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:26.290649 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:26.298326 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:26.298777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:26.299553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:26.300020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:26.337945 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.353775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f5d9b924-8d70-495d-a536-364ef15a4636 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.232503 Jun 30 15:51:26.354510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 67/126] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:26 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:26.485811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.497998 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.499799 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:26.501098 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-84c569ab-694b-4c3c-9fe7-f570c45139a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.215388 Jun 30 15:51:26.501674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 60/127] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:26 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:27.136999 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:27.137671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:27.145850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.146758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.147692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.148295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.180649 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:27.181256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:27.189844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.190287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.191068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.191505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.646946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.650186 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.656026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ab65222b-d70d-4f84-b3db-0170cd403b16 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.523537 Jun 30 15:51:27.658535 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4901afe7-3d51-40be-ae77-67edbbe6fd54 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.483521 Jun 30 15:51:27.659124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 61/128] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:27 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:27.660636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 68/129] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:27 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:27.664330 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:27.664931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:27.671150 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.671595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.672393 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.672934 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.679422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:27.680074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:27.697659 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.698175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.698853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.699381 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.874780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.884357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-84c90f32-95b6-4259-993b-7e219c060833 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.223506 Jun 30 15:51:27.885549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 62/130] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:27 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:27.935673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.946416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.948041 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:27.949227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0b20919d-3714-4a2b-b71d-ff9094cc7495 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.287494 Jun 30 15:51:27.950145 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 69/131] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:27 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:27.956586 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-75cea1f6-118a-4cff-8f3c-0e6aec69923a req-1d1683ef-cad7-4206-baa9-08ee0e6c14f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0650698c-ce72-4d65-bb06-23af0543521a", "name": "network-vif-plugged", "status": "completed", "tag": "b419bf3d-cf4e-43db-962c-8fe5a23deadb"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:27.967209 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-75cea1f6-118a-4cff-8f3c-0e6aec69923a req-1d1683ef-cad7-4206-baa9-08ee0e6c14f4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:27.967662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-75cea1f6-118a-4cff-8f3c-0e6aec69923a req-1d1683ef-cad7-4206-baa9-08ee0e6c14f4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:27.989800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-75cea1f6-118a-4cff-8f3c-0e6aec69923a req-1d1683ef-cad7-4206-baa9-08ee0e6c14f4 service nova] Creating event network-vif-plugged:b419bf3d-cf4e-43db-962c-8fe5a23deadb for instance 0650698c-ce72-4d65-bb06-23af0543521a on hv-cinder-79760 Jun 30 15:51:27.995387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-75cea1f6-118a-4cff-8f3c-0e6aec69923a req-1d1683ef-cad7-4206-baa9-08ee0e6c14f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042340 Jun 30 15:51:27.996015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 63/132] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:28.677435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:28.678060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:28.686579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:28.687770 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:28.688351 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.689761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.690761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.691383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.695054 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.695511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.696329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.696759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.904548 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:28.912066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a0f5e7a5-9a67-410d-a47e-0a86749807f1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.229671 Jun 30 15:51:28.912641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 64/133] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:28 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:28.915219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:28.922015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:28.925718 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-38f60860-5dd0-44d9-a008-eb1814f9f753 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1315 microversion: 2.1 time: 0.253261 Jun 30 15:51:28.925857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:28.936308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 70/134] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:28 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:28.939173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.939913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.940727 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.941692 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.970099 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:28.970827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:28.986039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.986685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:28.988087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:28.991031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:29.182965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:29.191040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f607d1b3-a104-448f-a8b3-9c66b8935e63 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1364 microversion: 2.1 time: 0.277171 Jun 30 15:51:29.192201 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 65/135] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:28 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:29.220232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:29.229862 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:29.231422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:29.232560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5d40a94e-3682-4bcf-bc8d-639192e138e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.269625 Jun 30 15:51:29.233421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 71/136] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:28 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:29.929292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:29.930617 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:29.943086 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:29.944426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:29.954871 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:29.956665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:29.959625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:29.960795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:29.961595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:29.964024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:29.964757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:29.968741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.311269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.318801 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f3cbabdd-80e4-4b8f-914f-49f2bfda12f1 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1502 microversion: 2.1 time: 0.379683 Jun 30 15:51:30.319783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 72/137] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:29 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1502 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:30.325393 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:30.326163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:30.345418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.347216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.348384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.351008 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.362214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:30.418875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.429132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3096edbf-165a-474b-9db5-d6771c5d5596 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.503896 Jun 30 15:51:30.431215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 66/138] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:29 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:30.438356 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:30.438970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:30.455370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.455893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.458350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.458946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.807855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.816462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-583ac695-7a06-4260-9a56-bd876867636f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1551 microversion: 2.1 time: 0.495202 Jun 30 15:51:30.820714 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 73/139] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:30 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1551 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:30.842455 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:30.842955 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:30.855508 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.856018 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.856783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:30.857212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:30.909119 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.917557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.919114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:30.936383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d57706b6-ac90-4815-a747-203be30be4fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.487882 Jun 30 15:51:30.937475 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 67/140] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:30 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:31.069458 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fad454cc-3aa4-42fd-8f30-697d2f19681a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230960 Jun 30 15:51:31.076851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 74/141] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:51:30 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:31.449091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:31.449755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:31.456045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:31.456736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:31.457659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:31.458237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:31.672783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:31.684513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be7522e6-0a03-4e95-a489-1883149bdab0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1322 microversion: 2.1 time: 0.239061 Jun 30 15:51:31.694144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 68/142] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:31 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:31.950943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:31.956317 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:31.958499 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:31.977318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:31.983983 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-0d135acd-fbc5-494a-b28c-8ec76625ac4b req-2abefb66-73da-4122-8c4f-f2ea2065c714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "name": "network-vif-plugged", "status": "completed", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:31.995124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:31.997706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.002968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.013824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0d135acd-fbc5-494a-b28c-8ec76625ac4b req-2abefb66-73da-4122-8c4f-f2ea2065c714 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.014704 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0d135acd-fbc5-494a-b28c-8ec76625ac4b req-2abefb66-73da-4122-8c4f-f2ea2065c714 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.063848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-0d135acd-fbc5-494a-b28c-8ec76625ac4b req-2abefb66-73da-4122-8c4f-f2ea2065c714 service nova] Creating event network-vif-plugged:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:51:32.087236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-0d135acd-fbc5-494a-b28c-8ec76625ac4b req-2abefb66-73da-4122-8c4f-f2ea2065c714 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105728 Jun 30 15:51:32.100380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 69/143] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:32.131195 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ee7c1a1-6de0-4723-9450-33bbfd80d821"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:32.139055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:32.174542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.174542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.175882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.176349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.603863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:32.614250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:32.616547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:32.621558 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-96544f21-e49f-45b4-8a5d-eeb343561af6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.667959 Jun 30 15:51:32.622320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 75/144] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:31 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:32.702259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:32.703169 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:32.716029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.716493 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.717391 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:32.717849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:32.988978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:33.004418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4831f619-fccb-43ab-9929-4baa1b91577b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1516 microversion: 2.1 time: 0.305965 Jun 30 15:51:33.005575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 76/145] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:32 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1516 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:33.032102 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:33.033662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:33.049757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.050501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.051448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.052067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.090429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'flavor' on Instance uuid 0650698c-ce72-4d65-bb06-23af0543521a {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:51:33.314995 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-72e319b8-c1ad-4b6a-a2df-2beeec099ccc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a/action" status: 200 len: 32 microversion: 2.1 time: 0.293064 Jun 30 15:51:33.331913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 77/146] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:51:33 2022] POST /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a/action => generated 32 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:51:33.337572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:33.338269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:33.360274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.360716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.367890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.368466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.384507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:33.435091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-06984566-0fa7-4ca3-9aa4-5ceacf473b38 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "POST /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.321887 Jun 30 15:51:33.435717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 70/147] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:51:32 2022] POST /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c/os-volume_attachments => generated 194 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:33.446484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-be83d512-788a-4d03-b815-eb3a4993e15a req-1c601a6b-ff97-411d-8f73-d2f70fb1c347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85185f0-6858-4750-a044-9c3dc44d0240", "tag": "b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:33.472061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-be83d512-788a-4d03-b815-eb3a4993e15a req-1c601a6b-ff97-411d-8f73-d2f70fb1c347 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.472921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-be83d512-788a-4d03-b815-eb3a4993e15a req-1c601a6b-ff97-411d-8f73-d2f70fb1c347 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.492595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-be83d512-788a-4d03-b815-eb3a4993e15a req-1c601a6b-ff97-411d-8f73-d2f70fb1c347 service nova] Creating event network-changed:b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8 for instance b85185f0-6858-4750-a044-9c3dc44d0240 on hv-cinder-79760 Jun 30 15:51:33.503823 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-be83d512-788a-4d03-b815-eb3a4993e15a req-1c601a6b-ff97-411d-8f73-d2f70fb1c347 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062645 Jun 30 15:51:33.504462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 71/148] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:33.640429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:33.641291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:33.650890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.651582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.652526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:33.653160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:33.713630 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:33.722308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b8e1dab6-d683-41fa-a92e-fb63a791fab9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.388923 Jun 30 15:51:33.726831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 78/149] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:33 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:33.738212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-370643017", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "networks": [{"uuid": "1eb222fd-b3cd-49a8-b4c4-ad303c50a583"}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:33.822747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] validate_networks() for [('1eb222fd-b3cd-49a8-b4c4-ad303c50a583', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:51:34.221967 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:34.239905 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:34.244302 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:34.248235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d6282ab3-9359-4e0e-ad75-f4efbcce15db tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.612768 Jun 30 15:51:34.249162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 72/150] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:33 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:34.729571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:51:34.730601 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:51:34.731243 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:51:34.731942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:51:34.732517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:51:34.744729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:34.745379 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:34.746115 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:34.746520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:34.747423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:34.748051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:34.758169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:34.758722 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:34.760309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:34.760949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:34.773318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Getting quotas for project cd4585e1e7524dd78f3cf187684ee2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:51:34.777979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Getting quotas for user 17123d3e5fe945bbb1cb835f154965d4 and project cd4585e1e7524dd78f3cf187684ee2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:51:34.790231 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:51:34.794320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:51:34.902476 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-66387f6d-1a4c-4460-8c26-471fba0ed65d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174495 Jun 30 15:51:34.903386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 79/151] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:51:34.928399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7e859ca5-adee-4b5e-82a2-fe237bf38bca tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:34.931452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7e859ca5-adee-4b5e-82a2-fe237bf38bca tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:34.956301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:35.068453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7e859ca5-adee-4b5e-82a2-fe237bf38bca tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:35.071829 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:35.078154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7e859ca5-adee-4b5e-82a2-fe237bf38bca tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1213 microversion: 2.1 time: 0.167204 Jun 30 15:51:35.081841 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ca9bc5cb-6363-40b8-80b2-c2166dd1fcfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.340889 Jun 30 15:51:35.082416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 80/153] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:34 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:35.082526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 73/153] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:34 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:35.266920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:35.281769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:35.299927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:35.300620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:35.301971 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:35.303943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:35.840021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:35.848183 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:35.849760 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:35.850958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-79ee4d72-d443-42c1-b21c-a7c8bb3a2551 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1407 microversion: 2.20 time: 0.588242 Jun 30 15:51:35.851580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 74/154] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:35 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:51:36.098625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:36.099310 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:36.099809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:36.100569 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:36.105905 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.106353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:36.107112 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.107547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:36.110404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.110897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:36.113044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.113044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:36.202203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:36.210494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a5c04fbd-46f2-4711-bf72-8bcbdb7da0c1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1265 microversion: 2.1 time: 0.115465 Jun 30 15:51:36.211163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 81/155] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:36 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:36.276809 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:36.287201 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f701441d-71c2-44f1-a933-c8f84be995a7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.192344 Jun 30 15:51:36.288478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 75/156] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:36 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:36.874954 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:36.876112 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:36.886175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.886834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:36.887597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:36.888439 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.198199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:37.207707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:37.209243 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:37.210457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8bb456c5-13b5-4e5f-a53c-a45924e5751a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1600 microversion: 2.20 time: 0.342895 Jun 30 15:51:37.211032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 82/157] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:51:36 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1600 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:51:37.229596 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:37.230216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:37.233395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:37.234146 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:37.241924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.242629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.243607 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.244269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.253056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.253513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.255871 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.256715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.419174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:37.437241 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c181ecb9-a9b3-48e3-b3bd-de9c75f3a18d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1271 microversion: 2.1 time: 0.210909 Jun 30 15:51:37.446703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 76/158] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:37 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:37.449845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:37.450528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:37.457211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.457751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.458575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:37.459066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:37.479941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bf3f3e0f-b0f3-4967-8f5c-7dc5f00995f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.251313 Jun 30 15:51:37.481343 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 83/159] 10.222.0.50 () {60 vars in 1315 bytes} [Thu Jun 30 15:51:37 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:51:37.931211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:37.940532 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1b6a4408-7258-45dc-acc0-45a6099e2cfa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.500813 Jun 30 15:51:37.944826 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 77/160] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:37 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:38.457547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:38.460308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:38.478966 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:38.481074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:38.482678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:38.484899 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:38.937948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:38.946501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d74e045f-b8d0-450b-ba18-c68b718d8d10 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.495260 Jun 30 15:51:38.947082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 84/161] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:38 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:38.961709 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:38.962318 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:38.970328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:38.972133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:38.972909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:38.973343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:39.314604 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:39.338155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c212e1c8-9ee9-4f91-83cc-c8d6838323f8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.380208 Jun 30 15:51:39.341321 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 78/162] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:38 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:39.903712 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-a2f12227-7efa-4563-a454-b544dfb1a4e3 req-9b656d45-3c7d-4599-a66e-d30809e3f0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:39.923511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a2f12227-7efa-4563-a454-b544dfb1a4e3 req-9b656d45-3c7d-4599-a66e-d30809e3f0a3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:39.923949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a2f12227-7efa-4563-a454-b544dfb1a4e3 req-9b656d45-3c7d-4599-a66e-d30809e3f0a3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:39.940836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-a2f12227-7efa-4563-a454-b544dfb1a4e3 req-9b656d45-3c7d-4599-a66e-d30809e3f0a3 service nova] Creating event network-changed:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:51:39.946227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-a2f12227-7efa-4563-a454-b544dfb1a4e3 req-9b656d45-3c7d-4599-a66e-d30809e3f0a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046729 Jun 30 15:51:39.947463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 85/163] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:39.973361 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:39.974010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:39.995889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:39.996440 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:39.997224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:39.997662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:40.360347 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:40.361686 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:40.367597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:40.373379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:40.373851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:40.374634 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:40.375065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:40.378417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0c08e637-504a-4154-ae6f-e854fec5973c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.419430 Jun 30 15:51:40.387833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 79/164] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:39 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:40.721113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:40.730382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2a6097df-b8db-4ac6-a0a7-55b83c0c278b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.375587 Jun 30 15:51:40.732942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 86/165] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:40 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:41.406906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:41.407517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:41.415671 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:41.416345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:41.417912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:41.418875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:41.649643 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:41.659343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-42c7c53c-051b-401f-aa42-453194b79504 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.258538 Jun 30 15:51:41.663111 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 80/166] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:41 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:41.750005 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:41.750722 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:41.758046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:41.758724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:41.760137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:41.760723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.058280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-ef1a7fa9-df08-4850-a169-29a887210be0 req-50c1576d-843d-4f68-95c4-61742e6c4737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611c3e87-a366-4045-a0c2-0001ad5d40fe", "tag": "2fa17815-d88b-46f0-97af-8784a06ce56f"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:42.063635 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=91 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:42.070438 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ef1a7fa9-df08-4850-a169-29a887210be0 req-50c1576d-843d-4f68-95c4-61742e6c4737 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.070898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ef1a7fa9-df08-4850-a169-29a887210be0 req-50c1576d-843d-4f68-95c4-61742e6c4737 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.082637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-ef1a7fa9-df08-4850-a169-29a887210be0 req-50c1576d-843d-4f68-95c4-61742e6c4737 service nova] Creating event network-changed:2fa17815-d88b-46f0-97af-8784a06ce56f for instance 611c3e87-a366-4045-a0c2-0001ad5d40fe on hv-cinder-79760 Jun 30 15:51:42.088567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-ef1a7fa9-df08-4850-a169-29a887210be0 req-50c1576d-843d-4f68-95c4-61742e6c4737 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035276 Jun 30 15:51:42.089615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 81/167] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:42.233961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:42.241815 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ac60feda-664f-453d-9cb9-4e88e8003357 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.495644 Jun 30 15:51:42.242361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 87/168] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:41 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:42.596200 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:42.598848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:42.607542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.608954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.610600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.611409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.640361 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:51:42.678926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:42.679666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:42.688244 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.689869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.691323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.693100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.795194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c3af8fe3-cfb6-465d-bf71-c623904aea99 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "DELETE /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 204 len: 0 microversion: 2.1 time: 0.204386 Jun 30 15:51:42.796394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 82/169] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:51:42 2022] DELETE /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:51:42.808844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:42.810060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:42.820395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.821122 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.821930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:42.822506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:42.931167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:42.948743 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9dd24188-8ada-45d8-a3bf-5d6c4c51d460 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.272940 Jun 30 15:51:42.950113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 88/170] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:42 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:43.006684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:43.018504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f24c228b-9924-4b87-9f64-21e38edeb4bb tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1554 microversion: 2.1 time: 0.216769 Jun 30 15:51:43.033259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 83/171] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:42 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:43.260258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:43.276753 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:43.290670 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:43.291421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:43.292222 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:43.292650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:43.439854 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:43.448867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5f754c45-04a3-4aad-b9c8-3033f87d0c51 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.193100 Jun 30 15:51:43.449998 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 89/172] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:43 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:43.974187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:43.974805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:43.983464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:43.983917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:43.984728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:43.995821 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:44.040215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:44.041450 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:44.048576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:44.049209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:44.050391 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:44.051075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:44.207599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:44.215086 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e7745c07-322e-4712-aacc-cf41cea58e45 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.252848 Jun 30 15:51:44.216178 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 84/173] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:43 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:44.235812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:44.239876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:44.246639 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-46e539ed-ba3d-4aa4-aa44-97bcd8f9649d tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1554 microversion: 2.1 time: 0.210328 Jun 30 15:51:44.247294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 90/174] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:44 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:44.465507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:44.466123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:44.472645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:44.473490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:44.474729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:44.475197 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:44.623527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:44.632958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ee363784-ef40-4364-9c72-ecb82598ccc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.171016 Jun 30 15:51:44.633723 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 85/175] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:44 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:45.232196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:45.232900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:45.235088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:45.235741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=8 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:45.243171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.243598 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.244392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.244817 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.265494 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:45.266365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:45.274189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.274638 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.275399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.276072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.479111 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:45.486099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:45.490202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:51:45.496896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c8e63802-3479-4a1c-bade-e4daf859dd96 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1554 microversion: 2.1 time: 0.235409 Jun 30 15:51:45.498065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 86/176] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:45 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:45.499391 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6d0c9926-978d-4621-960f-6fbdeb2684e3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.271038 Jun 30 15:51:45.511056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 91/177] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:45 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:45.652455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:45.652964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:45.659768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.660590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.661338 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:45.661884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:45.816484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:45.826737 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1089e705-9fd8-47e5-8a3f-9892635f3159 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.180153 Jun 30 15:51:45.837172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 87/178] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:45 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:46.516818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:46.517390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:46.520221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:46.521267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:46.525997 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.526370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.527141 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.527600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.530698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.531303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.532250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.532820 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.914341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:46.928388 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-687b5efa-3dff-4cf2-8ce5-5f70e584cc06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.413913 Jun 30 15:51:46.929331 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 88/179] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:46 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:46.940576 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:46.950339 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:46.953900 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.954350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.955114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:46.955547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:46.963745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:46.974528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4c95d642-4cea-4a7b-a36c-2b34da50b972 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1554 microversion: 2.1 time: 0.464129 Jun 30 15:51:46.979194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 92/180] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:46 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1554 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:47.249436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:47.282846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-974943b1-687b-44f3-bea6-936824489289 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.349270 Jun 30 15:51:47.283534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 89/181] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:46 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:47.583747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-4f3e1bb3-fd14-4494-bba3-a56fd2e238b7 req-accfd09c-43fd-46c2-8527-ef3e38b5e42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c", "name": "network-vif-deleted", "tag": "8ba5991f-fae8-42bd-a8de-ede01c27a8f7"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:47.595602 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4f3e1bb3-fd14-4494-bba3-a56fd2e238b7 req-accfd09c-43fd-46c2-8527-ef3e38b5e42f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:47.596245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4f3e1bb3-fd14-4494-bba3-a56fd2e238b7 req-accfd09c-43fd-46c2-8527-ef3e38b5e42f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:47.609706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-4f3e1bb3-fd14-4494-bba3-a56fd2e238b7 req-accfd09c-43fd-46c2-8527-ef3e38b5e42f service nova] Creating event network-vif-deleted:8ba5991f-fae8-42bd-a8de-ede01c27a8f7 for instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c on hv-cinder-79760 Jun 30 15:51:47.617000 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-4f3e1bb3-fd14-4494-bba3-a56fd2e238b7 req-accfd09c-43fd-46c2-8527-ef3e38b5e42f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037663 Jun 30 15:51:47.617923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 93/182] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:47.946699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:47.947435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:47.954474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:47.960782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-64d1ebaa-e672-4850-9450-9b4d3b3e1382 req-75339227-73ea-4fea-a0e1-14931049c1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c3e87-a366-4045-a0c2-0001ad5d40fe", "name": "network-vif-plugged", "status": "completed", "tag": "2fa17815-d88b-46f0-97af-8784a06ce56f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:47.965679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:47.967709 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:47.968701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:47.974728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-64d1ebaa-e672-4850-9450-9b4d3b3e1382 req-75339227-73ea-4fea-a0e1-14931049c1f8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:47.976318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-64d1ebaa-e672-4850-9450-9b4d3b3e1382 req-75339227-73ea-4fea-a0e1-14931049c1f8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:48.017331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-64d1ebaa-e672-4850-9450-9b4d3b3e1382 req-75339227-73ea-4fea-a0e1-14931049c1f8 service nova] Creating event network-vif-plugged:2fa17815-d88b-46f0-97af-8784a06ce56f for instance 611c3e87-a366-4045-a0c2-0001ad5d40fe on hv-cinder-79760 Jun 30 15:51:48.029725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-64d1ebaa-e672-4850-9450-9b4d3b3e1382 req-75339227-73ea-4fea-a0e1-14931049c1f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072950 Jun 30 15:51:48.033437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 94/183] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:48.043197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:48.044110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:48.050485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:48.051013 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:48.051830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:48.052486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:48.172785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead6569ad30b496092f49b3fe0c8a706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b65df0cd27d479e9bc39ecb95ff04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:48.184017 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8b159454-a293-490a-819d-786bd9b36bc6 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 200 len: 1346 microversion: 2.1 time: 0.149167 Jun 30 15:51:48.184933 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 95/184] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:48 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:48.207332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:48.215320 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-97f70892-3fb2-4054-9c44-e434122356ac tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.272333 Jun 30 15:51:48.216267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 90/185] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:47 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:48.299881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:48.300543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:48.307601 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:48.308688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:48.309704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:48.310384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:48.456387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:48.463881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f501ab1c-843c-42c8-bd59-b26683392337 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.168011 Jun 30 15:51:48.464563 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 96/186] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:48 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:49.202290 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:49.203029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:49.209701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.210225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.211084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.211578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.227386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] HTTP exception thrown: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Request method failure captured: Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c HTTP/1.1 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZVqZ48A1bkdnSiUdN8i_ZZ4MS6e1pQoiDkXhpx_WwUxJ4ABVU_TYjN7Q01rZrBvJCghVqI2_TXY7ob21nRyUTdK5KVWuxa5kLeBoGkdf01LGoXA-uUKiLxiZeWKnlyQ3x88suCnrCE6vFwZtmAXC-7Z4TFPBylTBR5bn4Up7_aYT8 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:51:49.232812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b65df0cd27d479e9bc39ecb95ff04d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: ead6569ad30b496092f49b3fe0c8a706 Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.234118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c'} Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:51:49.234895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.236066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.237367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:49.237367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:49.239922 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Returning 404 to user: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:51:49.240260 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.240721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.240867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-66186e30-1313-40d3-80cf-8e0fd28debec tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 404 len: 111 microversion: 2.1 time: 0.042576 Jun 30 15:51:49.241495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.241828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 91/187] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:49 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:51:49.241932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.367747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:49.368849 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:49.375943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.376644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.377681 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.379113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.394017 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:49.395570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] HTTP exception thrown: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Request method failure captured: Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c/os-volume_attachments HTTP/1.1 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZVqZ48A1bkdnSiUdN8i_ZZ4MS6e1pQoiDkXhpx_WwUxJ4ABVU_TYjN7Q01rZrBvJCghVqI2_TXY7ob21nRyUTdK5KVWuxa5kLeBoGkdf01LGoXA-uUKiLxiZeWKnlyQ3x88suCnrCE6vFwZtmAXC-7Z4TFPBylTBR5bn4Up7_aYT8 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:51:49.397574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b65df0cd27d479e9bc39ecb95ff04d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: ead6569ad30b496092f49b3fe0c8a706 Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.398827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'server_id': '79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c'} Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:51:49.399481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:49.400564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:49.401672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Returning 404 to user: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:51:49.401672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9335ce10-c909-4680-9e0e-e87a3de2a554 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036978 Jun 30 15:51:49.404721 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 92/188] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:51:49 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:51:49.413046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-add55055-5708-4dd9-a316-f92635e34be2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.184096 Jun 30 15:51:49.413809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 97/189] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:49 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:49.481851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:49.482914 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:49.490799 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.491483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.492924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:49.493802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:49.652211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:49.660329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5cf2d505-3171-4be9-abd3-ca788d1a9627 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.183641 Jun 30 15:51:49.661315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 93/190] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:49 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:50.429942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:50.430576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:50.437056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.437506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.438420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.439000 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.578932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:50.594908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-68798ec1-e0d8-43ec-b247-df40d09aa1ed tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1313 microversion: 2.1 time: 0.168876 Jun 30 15:51:50.595943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 98/191] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:50 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:50.652944 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:50.654558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:50.663751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.664749 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.665947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.666478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.678658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:50.679271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:50.682362 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] HTTP exception thrown: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Request method failure captured: Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: DELETE /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c HTTP/1.1 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZVqZ48A1bkdnSiUdN8i_ZZ4MS6e1pQoiDkXhpx_WwUxJ4ABVU_TYjN7Q01rZrBvJCghVqI2_TXY7ob21nRyUTdK5KVWuxa5kLeBoGkdf01LGoXA-uUKiLxiZeWKnlyQ3x88suCnrCE6vFwZtmAXC-7Z4TFPBylTBR5bn4Up7_aYT8 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:51:50.684641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b65df0cd27d479e9bc39ecb95ff04d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: ead6569ad30b496092f49b3fe0c8a706 Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.686121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c'} Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:51:50.686981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.688382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.689708 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Returning 404 to user: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:51:50.689790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.689879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7df669c0-38a0-4252-9033-6758a9974507 tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "DELETE /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 404 len: 111 microversion: 2.1 time: 0.039690 Jun 30 15:51:50.689973 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.689973 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.690156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 94/192] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:51:50 2022] DELETE /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:51:50.692515 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.697466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:50.698080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] [instance: 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:50.704574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.705020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.705908 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:50.706330 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:50.722547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] HTTP exception thrown: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Request method failure captured: Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c HTTP/1.1 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZVqZ48A1bkdnSiUdN8i_ZZ4MS6e1pQoiDkXhpx_WwUxJ4ABVU_TYjN7Q01rZrBvJCghVqI2_TXY7ob21nRyUTdK5KVWuxa5kLeBoGkdf01LGoXA-uUKiLxiZeWKnlyQ3x88suCnrCE6vFwZtmAXC-7Z4TFPBylTBR5bn4Up7_aYT8 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:51:50.724072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b65df0cd27d479e9bc39ecb95ff04d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b65df0cd27d479e9bc39ecb95ff04d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 4b65df0cd27d479e9bc39ecb95ff04d7 Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-DeleteServersTestJSON-1657295908 Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: ead6569ad30b496092f49b3fe0c8a706 Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-DeleteServersTestJSON-1657295908-project Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.725558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c'} Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:51:50.726315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. Jun 30 15:51:50.727665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:50.728917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] Returning 404 to user: Instance 79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:51:50.728917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-bc4d034e-830a-491f-b0db-b6f077b72dff tempest-DeleteServersTestJSON-1657295908 tempest-DeleteServersTestJSON-1657295908-project] 10.222.0.50 "GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c" status: 404 len: 111 microversion: 2.1 time: 0.031855 Jun 30 15:51:50.728917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 95/193] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:50 2022] GET /compute/v2.1/servers/79b80c44-3d6f-4cbf-a2cf-1aeeb77f021c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 15:51:50.837505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:50.845863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1213ab95-0186-40f8-8d5e-59d20049304c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.171990 Jun 30 15:51:50.846493 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 99/194] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:50 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:51.611965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:51.612928 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:51.621846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:51.622542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:51.628122 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:51.628780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:51.865441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:51.866064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:51.877762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:51.878199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:51.878965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:51.879387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:51.912888 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:51.922946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-dbdf7165-4eb8-4ad4-92e6-b7816523f0a2 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1497 microversion: 2.1 time: 0.314170 Jun 30 15:51:51.926068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 96/195] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:51 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1497 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:52.136626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:52.149572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8d60babb-cd41-4ef3-b2f0-cc5b93280a2f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.289068 Jun 30 15:51:52.150549 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 100/196] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:51 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:52.648451 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:52.649432 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:52.656999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:52.657433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:52.658192 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:52.658616 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:52.697377 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:51:52.814921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-010e04df-1f02-49a0-9194-68b57b5032e1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "DELETE /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 204 len: 0 microversion: 2.1 time: 0.169167 Jun 30 15:51:52.815851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 97/197] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:51:52 2022] DELETE /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:51:52.828602 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:52.829333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:52.836514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:52.837761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:52.838869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:52.839691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:53.168542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:53.169251 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:53.181343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:53.181794 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:53.186618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:53.187156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:53.905035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:53.919087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6337840c-6516-4715-bb49-d2ee14c8cb32 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1503 microversion: 2.1 time: 1.096155 Jun 30 15:51:53.926378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 101/198] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:52 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1503 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:53.978284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:53.986015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e0e2527b-3a49-47b4-8815-f64d5d7e8cbc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.822507 Jun 30 15:51:53.986573 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 98/199] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:53 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:54.937034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:54.940870 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:54.948552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:54.949125 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:54.950345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:54.950964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:55.004326 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:55.005125 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:55.020123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:55.020689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:55.022001 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:55.023018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:55.471948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:55.480855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-678d2d45-6818-41a2-9d1b-cbc093ec766e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1503 microversion: 2.1 time: 0.548255 Jun 30 15:51:55.490706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 102/200] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:54 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1503 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:55.560941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:55.568583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7c788f78-3353-47e7-bd64-6961214c86b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.569604 Jun 30 15:51:55.578496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 99/201] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:54 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:56.124252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-6c94348e-44e9-4e12-bdd5-469911e86f6f req-eb9ccd22-5324-4685-b294-f11fe0fd5f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c3e87-a366-4045-a0c2-0001ad5d40fe", "name": "network-vif-deleted", "tag": "2fa17815-d88b-46f0-97af-8784a06ce56f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:56.147786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6c94348e-44e9-4e12-bdd5-469911e86f6f req-eb9ccd22-5324-4685-b294-f11fe0fd5f5e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.150053 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6c94348e-44e9-4e12-bdd5-469911e86f6f req-eb9ccd22-5324-4685-b294-f11fe0fd5f5e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.178882 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-6c94348e-44e9-4e12-bdd5-469911e86f6f req-eb9ccd22-5324-4685-b294-f11fe0fd5f5e service nova] Creating event network-vif-deleted:2fa17815-d88b-46f0-97af-8784a06ce56f for instance 611c3e87-a366-4045-a0c2-0001ad5d40fe on hv-cinder-79760 Jun 30 15:51:56.189949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-6c94348e-44e9-4e12-bdd5-469911e86f6f req-eb9ccd22-5324-4685-b294-f11fe0fd5f5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070363 Jun 30 15:51:56.198117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 103/202] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:51:56.498695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:56.500176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:56.508834 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.513412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.513412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.513412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.563230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.563680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.564176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lazy-loading 'fault' on Instance uuid 611c3e87-a366-4045-a0c2-0001ad5d40fe {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:51:56.587124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:56.588256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:56.595033 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.597395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.598345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:56.598927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:56.623940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:56.631950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d54e08da-a0e7-4bd4-8408-c36399176f13 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 200 len: 1303 microversion: 2.1 time: 0.137705 Jun 30 15:51:56.633618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 100/203] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:56 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:56.770354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:56.778810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-408822a3-9e15-4069-a6c6-cebd1e5408ac tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.196490 Jun 30 15:51:56.780260 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 104/204] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:56 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:57.057985 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-654405987", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:57.117740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] validate_networks() for None {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:51:57.415414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:51:57.415830 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:51:57.416329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:51:57.417028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:51:57.417501 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:51:57.428273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.428640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.429714 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.430182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.452291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Getting quotas for project 5ac1871137494335b9cee22170d3315b. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:51:57.456562 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Getting quotas for user f2b4682563a24786804dee37d5ee31eb and project 5ac1871137494335b9cee22170d3315b. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:51:57.469660 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:51:57.472488 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:51:57.527468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fda40065-7d45-4caf-9879-066fa7101402 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474160 Jun 30 15:51:57.532909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 101/205] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:51:57.539864 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bb3dba67-e38f-434c-8240-d71836864c9b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:57.540641 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bb3dba67-e38f-434c-8240-d71836864c9b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:57.650216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:57.650843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 611c3e87-a366-4045-a0c2-0001ad5d40fe] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:57.652596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bb3dba67-e38f-434c-8240-d71836864c9b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:57.662026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bb3dba67-e38f-434c-8240-d71836864c9b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1214 microversion: 2.1 time: 0.126169 Jun 30 15:51:57.663617 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 105/206] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:57 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:57.668880 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.669349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.670796 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.671235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.729296 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] HTTP exception thrown: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Request method failure captured: Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe HTTP/1.1 Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcaDNrZjwgCwliropO6FDzi7pRk2TgjX1ASjWjbGjuXQpaycmXs30IGv-DiiAT45LDPp0t7XbiKXcKar7taqfjxOANK5LcLLiJctVoETdo6KuVGQisrYQvtUNAKZolzMxLZIpWoLiYA1dauLHBNoljHIv_II3Gsu1-W8NVw_4VloS-E Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: cd4585e1e7524dd78f3cf187684ee2ba Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-VolumesActionsTest-230151630 Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:51:57.733859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd4585e1e7524dd78f3cf187684ee2ba", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-VolumesActionsTest-230151630 Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: cd4585e1e7524dd78f3cf187684ee2ba Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-VolumesActionsTest-230151630 Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-VolumesActionsTest-230151630-project Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 17123d3e5fe945bbb1cb835f154965d4 Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-VolumesActionsTest-230151630-project Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. Jun 30 15:51:57.735056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '611c3e87-a366-4045-a0c2-0001ad5d40fe'} Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:51:57.735755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. Jun 30 15:51:57.737037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:51:57.738064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Returning 404 to user: Instance 611c3e87-a366-4045-a0c2-0001ad5d40fe could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:51:57.738064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d6436960-91e2-4e81-80f0-0ee018a8b658 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe" status: 404 len: 111 microversion: 2.1 time: 0.089634 Jun 30 15:51:57.738064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 102/207] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:57 2022] GET /compute/v2.1/servers/611c3e87-a366-4045-a0c2-0001ad5d40fe => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:51:57.800293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:57.800903 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:57.810228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.811090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.812154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:57.812777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:57.923959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-359531827", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "networks": [{"uuid": "1eb222fd-b3cd-49a8-b4c4-ad303c50a583"}]}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:51:57.987073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] validate_networks() for [('1eb222fd-b3cd-49a8-b4c4-ad303c50a583', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:51:58.131452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:58.138925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8493436a-da88-4b6c-8727-2a35cf643feb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.344503 Jun 30 15:51:58.149604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 106/208] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:57 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:58.552038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:51:58.552517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:51:58.552901 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:51:58.553460 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:51:58.554013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:51:58.565247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:58.565710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:58.566511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:58.567287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:58.590524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Getting quotas for project cd4585e1e7524dd78f3cf187684ee2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:51:58.600170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Getting quotas for user 17123d3e5fe945bbb1cb835f154965d4 and project cd4585e1e7524dd78f3cf187684ee2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:51:58.615697 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:51:58.620394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:51:58.676777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a82a4203-94c1-4d54-b4c4-aeb8c50788f6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756499 Jun 30 15:51:58.678202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 103/209] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:51:58.681449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:58.683246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:58.690674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4666613b-ea18-482b-b754-06b14fc9b74f tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:58.691775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4666613b-ea18-482b-b754-06b14fc9b74f tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:58.693416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:58.694197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:58.695888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:58.696602 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:58.753791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4666613b-ea18-482b-b754-06b14fc9b74f tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:58.771217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4666613b-ea18-482b-b754-06b14fc9b74f tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1213 microversion: 2.1 time: 0.086766 Jun 30 15:51:58.777918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 104/210] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:58 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:58.827777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:58.838777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-74c5d991-f16f-4522-bd24-7c5af2c8e62f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1266 microversion: 2.1 time: 0.162781 Jun 30 15:51:58.839981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 107/211] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:58 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:51:59.162275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:59.163474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:59.175701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.176765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.177640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.178258 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.334636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:59.345230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e2f865d9-4b37-46b9-88b5-87e8f6936b59 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.192746 Jun 30 15:51:59.355514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 105/212] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:59 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:59.795215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:59.796093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:59.802572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.803102 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.803937 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.804465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.856987 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:51:59.857587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:51:59.869082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.869749 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.870719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:51:59.871285 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:51:59.889772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:59.899817 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b8e53fa3-3fc7-44a1-88c3-0008e9cd9284 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1265 microversion: 2.1 time: 0.107034 Jun 30 15:51:59.902430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 108/213] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:59 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:51:59.957033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:51:59.966841 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6c18b3d1-8840-498d-a480-ecb137bce639 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1272 microversion: 2.1 time: 0.113864 Jun 30 15:51:59.968139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 106/214] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:51:59 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:00.367050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:00.371211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:00.384232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.386437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:00.389731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.390739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:00.774196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:00.788035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-43223f43-8c7f-4276-81be-d8c3ed84781b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.428262 Jun 30 15:52:00.789350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 109/215] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:00 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:00.920756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:00.924235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:00.931511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.932292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:00.933455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.934055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:00.958904 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:00.984790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:00.985423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:00.992902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.993599 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:00.994939 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:00.995506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:01.019934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:01.067544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:01.076022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-489f03f3-c3b8-46de-8a42-080b7b1a0d6c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1271 microversion: 2.1 time: 0.159116 Jun 30 15:52:01.076995 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 107/216] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:00 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:01.342913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:01.352799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2cbdae19-b742-4cc8-a8cb-c860195acfde tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.372464 Jun 30 15:52:01.353497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 110/217] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:00 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:01.804865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:01.805461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:01.833771 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:01.834247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:01.834963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:01.835655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.068467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-3f38d279-4d11-4cd9-8744-f64442f0c243 req-f327442d-ad68-4c22-ae90-be63c5327b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c932da-4e7a-4456-ab3b-6eb3fe6a34bd", "tag": "708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:02.102527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-3f38d279-4d11-4cd9-8744-f64442f0c243 req-f327442d-ad68-4c22-ae90-be63c5327b4c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:02.103792 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-3f38d279-4d11-4cd9-8744-f64442f0c243 req-f327442d-ad68-4c22-ae90-be63c5327b4c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.121019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-3f38d279-4d11-4cd9-8744-f64442f0c243 req-f327442d-ad68-4c22-ae90-be63c5327b4c service nova] Creating event network-changed:708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f for instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd on hv-cinder-79760 Jun 30 15:52:02.127200 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-3f38d279-4d11-4cd9-8744-f64442f0c243 req-f327442d-ad68-4c22-ae90-be63c5327b4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064366 Jun 30 15:52:02.128037 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 111/218] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:52:02.133661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:02.134799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:02.142122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:02.144176 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.144176 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:02.144176 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.262867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:02.282286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2673e086-67b1-469c-beab-15f6af68501c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.481313 Jun 30 15:52:02.282999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 108/219] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:01 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:02.379607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:02.385569 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:02.390753 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:02.402463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:02.402913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.403682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:02.404147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:02.559705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:02.579751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f8f3295b-e7a7-4f75-8e51-2d95f3ad86cd tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.449521 Jun 30 15:52:02.586364 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 112/220] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:02 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:02.748630 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:02.760626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1d250807-8137-4eaa-b73a-6cc3f3984ef4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.393668 Jun 30 15:52:02.769260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 109/221] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:02 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:03.300855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:03.302921 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:03.311931 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.313545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.315075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.316632 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.461449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:03.469019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a4e742d6-b56e-4ddc-a2a0-536ae82143f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.174188 Jun 30 15:52:03.469654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 113/222] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:03 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:03.597117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:03.598641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:03.606309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.607014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.607788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.608293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.744857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:03.755006 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-73ca21ac-cc9a-4b5a-a2f7-e491abb389c8 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.161758 Jun 30 15:52:03.755758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 110/223] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:03 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:03.777494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:03.778182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:03.784502 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.784969 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.785786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:03.786215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:03.917090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:03.924593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bca9cc22-ff91-442b-afec-c70a059f850b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.151085 Jun 30 15:52:03.925167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 114/224] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:03 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:04.156115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-13253b3a-3857-4b68-9edb-e12b4e7d807e req-a9f3a4bb-b9fd-4fbc-a9aa-6f843107a7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dfbcbe-8e35-4920-96c5-b678d77b673e", "tag": "e963f24a-c9f7-4861-986b-748baeda12ad"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:04.165105 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-13253b3a-3857-4b68-9edb-e12b4e7d807e req-a9f3a4bb-b9fd-4fbc-a9aa-6f843107a7b3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:04.165546 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-13253b3a-3857-4b68-9edb-e12b4e7d807e req-a9f3a4bb-b9fd-4fbc-a9aa-6f843107a7b3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:04.177889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-13253b3a-3857-4b68-9edb-e12b4e7d807e req-a9f3a4bb-b9fd-4fbc-a9aa-6f843107a7b3 service nova] Creating event network-changed:e963f24a-c9f7-4861-986b-748baeda12ad for instance 73dfbcbe-8e35-4920-96c5-b678d77b673e on hv-cinder-79760 Jun 30 15:52:04.183441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-13253b3a-3857-4b68-9edb-e12b4e7d807e req-a9f3a4bb-b9fd-4fbc-a9aa-6f843107a7b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031315 Jun 30 15:52:04.184058 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 111/225] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:04.488029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:04.490390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:04.499025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:04.499699 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:04.501221 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:04.502103 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:04.773719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:04.774679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:04.788534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:04.789825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:04.791010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:04.791537 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:05.110078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:05.119433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4afa90c6-9137-4bd4-a074-fbc25e8b0272 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.636699 Jun 30 15:52:05.120497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 115/226] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:04 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:05.125354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:05.126136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:05.128114 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=73 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:05.133993 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:05.134437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:05.135199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:05.135628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:05.176815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:05.184487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ac6ad629-9faf-4998-a148-23aecdbc1d7d tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.416576 Jun 30 15:52:05.185065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 112/227] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:04 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:05.376879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:05.389464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-79969754-c4d2-45ce-9f9e-44089347e69b tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.267487 Jun 30 15:52:05.390354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 116/228] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:05 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:06.141544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:06.142763 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:06.152265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.152708 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.153468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.153900 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.201382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:06.201952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:06.209142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.209636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.210405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.210837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.331818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:06.342655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ba6237fa-83d2-4cc6-ab27-29ffeee25982 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.207959 Jun 30 15:52:06.343661 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 113/229] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:06 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:06.382654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:06.390594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ecfee868-3495-4435-9a45-e89ccb1555c0 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.192994 Jun 30 15:52:06.391082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 117/230] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:06 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:06.410736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:06.411446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:06.419155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.419597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.420413 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:06.420846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:06.557397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:06.565076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-49a73468-60b9-4c91-81bc-d8260c816cca tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.158292 Jun 30 15:52:06.565641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 114/231] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:06 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:07.364505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:07.365511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:07.376459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.377205 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.378447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.379164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.406834 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:07.407406 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:07.414364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.414812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.415563 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.415967 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.565724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:07.573733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0f156f0f-966c-4045-b9be-8ee42f54db74 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.215950 Jun 30 15:52:07.574313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 118/232] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:07 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:07.582451 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:07.583028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:07.589172 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.589620 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.590376 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:07.590841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:07.593854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:07.601702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e378d23f-3605-455b-a39a-78e86349e431 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.198779 Jun 30 15:52:07.602255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 115/233] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:07 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:07.657420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:07.728624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:07.736530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c8920bb0-c231-41c0-8a0b-a9b6c3fe77f1 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.157776 Jun 30 15:52:07.737094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 119/234] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:07 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:08.592141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:08.592686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:08.595084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=4 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:08.600564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.601011 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.601777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.602215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.619191 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:08.619789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:08.626128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.626561 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.627327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.627741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.757923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=14 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:08.805626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:08.812711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:08.813286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-74f38d46-7b0f-4f16-a6ea-5c51f7e34c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.225598 Jun 30 15:52:08.813896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 116/235] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:08 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:08.818586 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:08.819206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:08.821383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1f3eb042-9389-4786-b432-780be5c7c86c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.206171 Jun 30 15:52:08.821923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 120/236] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:08 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:08.825721 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.826171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.826932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:08.827349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:08.969710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:08.977270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a3b2a8b8-818b-49e2-9dd4-46400be770b9 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.162408 Jun 30 15:52:08.978145 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 117/237] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:08 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:09.834414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:09.835430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:09.841387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:09.842415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:09.845819 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:09.846548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:09.847807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:09.848666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:09.853493 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:09.854283 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:09.855311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:09.855783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:10.040701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:10.044654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:10.048417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-edc77af8-c82e-4062-81db-238667375bba tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.213341 Jun 30 15:52:10.049058 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 118/238] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:09 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:10.052586 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7176cc79-179c-4cae-8329-eb8fe955da55 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.224744 Jun 30 15:52:10.053130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 121/239] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:09 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:10.053442 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:10.054239 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:10.060836 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:10.061285 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:10.062019 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:10.062454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:10.195648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:10.206636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0ea87b27-91b1-4053-ac42-e2735e2a284f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.156296 Jun 30 15:52:10.207279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 119/240] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:10 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:10.724291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-6ede53f9-919c-4767-af88-f79db0525c46 req-e238f529-2137-47f4-a782-06217ff64d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c932da-4e7a-4456-ab3b-6eb3fe6a34bd", "name": "network-vif-plugged", "status": "completed", "tag": "708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:10.733708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6ede53f9-919c-4767-af88-f79db0525c46 req-e238f529-2137-47f4-a782-06217ff64d61 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:10.734247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6ede53f9-919c-4767-af88-f79db0525c46 req-e238f529-2137-47f4-a782-06217ff64d61 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:10.746667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-6ede53f9-919c-4767-af88-f79db0525c46 req-e238f529-2137-47f4-a782-06217ff64d61 service nova] Creating event network-vif-plugged:708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f for instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd on hv-cinder-79760 Jun 30 15:52:10.753494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-6ede53f9-919c-4767-af88-f79db0525c46 req-e238f529-2137-47f4-a782-06217ff64d61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033079 Jun 30 15:52:10.754317 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 122/241] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:11.070010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:11.070843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:11.074071 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:11.074769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:11.079175 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.079613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.080398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.081293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.081446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.081874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.082645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.083080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.286804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:11.290401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:11.294595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5db61d7f-573f-444e-a46e-cb158fd557be tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.231570 Jun 30 15:52:11.295134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 120/242] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:11 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:11.298208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-765fbdb3-6e69-45f3-9241-629960a4fb65 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.231068 Jun 30 15:52:11.298760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 123/243] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:11 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:11.299897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:11.300496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:11.306440 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.306889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.307662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:11.308117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:11.441689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:11.453947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b1cb7684-4eb7-4c73-9f6f-61938e467f50 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.157371 Jun 30 15:52:11.454765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 121/244] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:11 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:12.312565 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:12.313480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:12.320465 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:12.321296 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.321833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:12.321966 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.323266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.323778 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.329622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.329966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.331007 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.331625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.596728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:12.601009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:12.606142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6504aacd-6f27-4eb7-82aa-a894b6abce12 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.298604 Jun 30 15:52:12.607255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 124/245] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:12 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:12.612477 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:12.613544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:12.618200 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-658c00a2-140e-470c-9c7a-2f69bf999ced tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.302002 Jun 30 15:52:12.619009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 122/246] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:12 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:12.627889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.627889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.627889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:12.627889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:12.773613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:12.781090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e21575af-138b-4436-bff2-b64c066483ab tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.172876 Jun 30 15:52:12.781643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 125/247] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:12 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:13.625746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:13.626416 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:13.635735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.636412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.636626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:13.637413 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.637594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:13.637991 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.646163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.646756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.647760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.648378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.834987 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:13.838307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:13.842700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c9a1d20b-664c-4e75-b876-64d2e71de2b3 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.222460 Jun 30 15:52:13.850091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 123/248] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:13 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:13.850280 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-34d4ef30-180f-4e87-9696-7ff8da1b04e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.214412 Jun 30 15:52:13.850280 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 126/249] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:13 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:13.850470 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:13.850470 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:13.855168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.855650 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.856468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:13.856903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:13.877793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:13.990961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:14.002505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-10728970-552b-4f17-b3ed-4d0bd59461c4 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.157929 Jun 30 15:52:14.003277 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 124/250] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:13 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:14.862446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:14.863650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:14.865960 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:14.866892 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:14.873365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:14.874048 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:14.875209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:14.875874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:14.876933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:14.877622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:14.878783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:14.879456 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:15.073710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:15.076873 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:15.081615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fe30e519-4579-4daf-acb1-ade9e3ad94e6 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.225197 Jun 30 15:52:15.082526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 127/251] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:14 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:15.085277 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e78ca72a-fe02-4e2a-8385-a49bff37ffb3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.225490 Jun 30 15:52:15.086022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 125/252] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:14 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:15.087350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:15.087971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:15.094057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:15.094494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:15.095237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:15.095661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:15.115569 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:15.228551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:15.240579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5ea79c9e-215f-4451-92d4-a77930fb207a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.156500 Jun 30 15:52:15.241329 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 128/253] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:15 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:16.103254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:16.104259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:16.106369 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:16.107371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:16.116299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.117551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.118026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.118739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.119008 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.119489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.120121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.120771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.320622 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:16.325061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:16.328405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4cd60458-d95c-4cca-96ca-c226702fc1d6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.228538 Jun 30 15:52:16.329189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 129/254] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:16 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:16.332878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2b111f79-7f2b-4ed4-ab6f-8cca858ebe4e tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.236542 Jun 30 15:52:16.333524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 126/255] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:16 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:16.343553 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:16.344192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:16.350525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.350982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.351723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.352188 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.481615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:16.490094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8f257893-c906-4f3e-8d08-405ed24e5fe3 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.150179 Jun 30 15:52:16.490694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 130/256] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:16 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:16.904410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-fee64ca4-0e33-42cc-bfdb-0da3fdb001fa req-86bc25ad-a1a2-4bca-b911-6c8669b3ecaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dfbcbe-8e35-4920-96c5-b678d77b673e", "name": "network-vif-plugged", "status": "completed", "tag": "e963f24a-c9f7-4861-986b-748baeda12ad"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:16.913191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-fee64ca4-0e33-42cc-bfdb-0da3fdb001fa req-86bc25ad-a1a2-4bca-b911-6c8669b3ecaf service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:16.913787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-fee64ca4-0e33-42cc-bfdb-0da3fdb001fa req-86bc25ad-a1a2-4bca-b911-6c8669b3ecaf service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:16.926059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-fee64ca4-0e33-42cc-bfdb-0da3fdb001fa req-86bc25ad-a1a2-4bca-b911-6c8669b3ecaf service nova] Creating event network-vif-plugged:e963f24a-c9f7-4861-986b-748baeda12ad for instance 73dfbcbe-8e35-4920-96c5-b678d77b673e on hv-cinder-79760 Jun 30 15:52:16.931391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-fee64ca4-0e33-42cc-bfdb-0da3fdb001fa req-86bc25ad-a1a2-4bca-b911-6c8669b3ecaf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Jun 30 15:52:16.932009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 127/257] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:17.348783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:17.349801 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:17.353634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:17.354552 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:17.358274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.358982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.360020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.360684 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.364853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.365594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.366745 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.367531 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.557841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:17.561374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:17.566000 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6a30962d-ebcc-433c-9c26-b238d8ec6fe9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.222437 Jun 30 15:52:17.566572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 131/258] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:17 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:17.571350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:17.572693 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:17.575383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5b07db92-ec29-4871-8953-d260cbc0692c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.228464 Jun 30 15:52:17.576022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 128/259] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:17 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:17.578425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.579040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.579715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:17.580184 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:17.713898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:17.721777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-20803c84-9427-43e3-9362-4f7aad140f9f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1314 microversion: 2.1 time: 0.154103 Jun 30 15:52:17.722346 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 132/260] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:17 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:18.583177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:18.583821 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:18.592025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.592462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.593378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.593842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.594314 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:18.595691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:18.603923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.604551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.605747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.606388 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.794111 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:18.799649 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:18.801978 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-52e4d1fb-6ae0-40e9-89e7-75d871f20a5a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.222930 Jun 30 15:52:18.802594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 129/261] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:18 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:18.807076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:18.807679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:18.813890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.814332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.814470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7fceef65-2b30-4a9d-ba05-3930db416d7c tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.225371 Jun 30 15:52:18.815072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:18.815214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 133/262] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:18 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:18.815493 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:18.952534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:18.960117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c242ea4e-dcf2-4081-aa79-8d1eaa62daf7 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1463 microversion: 2.1 time: 0.156582 Jun 30 15:52:18.960679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 130/263] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:18 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:19.016309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:19.016924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:19.026658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.027338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.028117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.028541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.053016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:52:19.156324 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3eab2d9d-c944-4301-90bf-1d11fd379350 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "DELETE /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 204 len: 0 microversion: 2.1 time: 0.145698 Jun 30 15:52:19.156814 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 134/264] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:52:19 2022] DELETE /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:52:19.165740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:19.166342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:19.172854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.173296 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.174144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.174566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.315537 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:19.324637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9637e066-a683-4174-bcc6-5a1314c54619 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.162714 Jun 30 15:52:19.325228 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 131/265] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:19 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:19.819866 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:19.820596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:19.827065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.827506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.828298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.828794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.831149 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:19.831778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:19.838824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.839291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:19.840107 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:19.840536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:20.025965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:20.029344 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:20.034486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-698431aa-a3a1-4cf8-bddb-8e64c4453a00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.218804 Jun 30 15:52:20.035445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 135/266] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:19 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:20.037912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-33fbd915-dcfd-472f-8d8e-271394491d44 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.210981 Jun 30 15:52:20.038567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 132/267] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:19 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:20.342657 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:20.343256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:20.350067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:20.350514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:20.351342 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:20.351781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:20.483177 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:20.491272 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-109e419b-41d9-4c1f-ad2e-05f5e39f218a tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.152673 Jun 30 15:52:20.491803 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 136/268] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:20 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:21.052901 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:21.053547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:21.054623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:21.055237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:21.060485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.060927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.061682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.061823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.062107 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.062251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.062891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.063323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.258995 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:21.262074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:21.267718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7175a590-baf9-4dc7-8b49-ebba7353027d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.219841 Jun 30 15:52:21.268692 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 133/269] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:21 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:21.273495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a76aa396-2af6-4ce5-b990-32a7b2b4c494 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.222298 Jun 30 15:52:21.274251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 137/270] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:21 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:21.512384 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:21.512986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:21.519453 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.519903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.520695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:21.521120 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:21.912732 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:21.924459 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-292dd723-a6c0-49ce-9c32-961c3a73ce16 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.418329 Jun 30 15:52:21.925036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 134/271] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:21 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:22.286034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:22.286593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:22.290495 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:22.291076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:22.293261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.293737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:22.294520 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.294952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:22.297773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.298212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:22.299005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.299429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:22.495131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:22.497821 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:22.505293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a0dc9d4d-39d4-468e-a66c-3386da1de14b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.223245 Jun 30 15:52:22.505853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 138/272] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:22 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:22.506229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-66f45c30-8b33-4c7a-bfb4-0cb8185c6fdc tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.219639 Jun 30 15:52:22.506894 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 135/273] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:22 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:22.947010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:22.948062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:22.955103 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.955550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:22.956406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:22.956885 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:23.092299 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:23.099752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c3e21147-b07e-4861-9df4-c988c51d040c tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.159957 Jun 30 15:52:23.100374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 139/274] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:22 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:23.522643 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:23.523264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:23.523622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:23.523710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:23.529924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:23.530162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:23.530337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:23.530637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:23.531122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:23.531396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:23.531538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:23.531825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:23.727842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:23.731116 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:23.736131 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ce68be53-fb05-4fc7-b5eb-1987d9877bb7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.217327 Jun 30 15:52:23.736738 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 136/275] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:23 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:23.739265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-640b23cb-262e-4ca4-a45d-91e49bee72cb tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.220469 Jun 30 15:52:23.739819 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 140/276] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:23 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:24.117156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:24.118202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:24.125959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.126461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.127664 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.128196 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.261174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:24.272032 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-113f6d49-4a75-43cb-babe-25d7f148e6c6 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.159017 Jun 30 15:52:24.272606 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 137/277] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:24 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:24.754207 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:24.754886 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:24.755545 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:24.762908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.763362 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.764166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.764597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.767689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:24.774579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.775025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.775912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:24.776418 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:24.955886 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:24.963908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cd693d9d-8999-4f20-8183-b478e00be581 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.214059 Jun 30 15:52:24.964571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 141/278] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:24 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:24.969607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:24.977246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cc39f3cd-db4b-400c-b318-01f2ef12cd70 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1313 microversion: 2.1 time: 0.225632 Jun 30 15:52:24.977812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 138/279] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:24 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:25.290746 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:25.291408 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:25.297842 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:25.298284 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:25.299040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:25.299466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:25.443742 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:25.451483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d560203e-f341-4c46-8e8f-b98ec970b446 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.165751 Jun 30 15:52:25.452068 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 142/280] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:25 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:25.982893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:25.983612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:25.991253 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:25.992092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:25.993036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:25.993634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:25.994900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:25.995516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:26.002148 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.002589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.003325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.003917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.028403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:26.153085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:26.160837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f272d259-f48a-44c5-ac3c-710911510db9 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1498 microversion: 2.1 time: 0.170032 Jun 30 15:52:26.172944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 143/281] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:25 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:26.397640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:26.407311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ed482465-bd3b-4c25-b247-cd54d440f413 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.428393 Jun 30 15:52:26.407865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 139/282] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:25 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:26.472117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:26.472960 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:26.483015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.483781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.496522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.497190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.709074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:26.717693 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f3ddf044-5eb7-4070-9d3e-2df3b3fdbc47 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1469 microversion: 2.1 time: 0.252399 Jun 30 15:52:26.718325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 144/283] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:26 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:26.744272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:26.744769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:26.750767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.751452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.752236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.752683 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.777943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:52:26.816093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:26.873942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-98798fcf-7caf-4244-a230-fb466471ce6b tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 204 len: 0 microversion: 2.1 time: 0.133041 Jun 30 15:52:26.874920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 140/284] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:52:26 2022] DELETE /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:52:26.882918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:26.883489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:26.890655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.891238 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.892112 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.892603 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.893188 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-6d585cbc-8bea-4377-9cb0-67b7465ae61c req-f6a35f8e-8ab8-4cf4-89e2-78545ec636f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c932da-4e7a-4456-ab3b-6eb3fe6a34bd", "name": "network-vif-deleted", "tag": "708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:26.901912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-6d585cbc-8bea-4377-9cb0-67b7465ae61c req-f6a35f8e-8ab8-4cf4-89e2-78545ec636f3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:26.902712 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-6d585cbc-8bea-4377-9cb0-67b7465ae61c req-f6a35f8e-8ab8-4cf4-89e2-78545ec636f3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:26.914801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-6d585cbc-8bea-4377-9cb0-67b7465ae61c req-f6a35f8e-8ab8-4cf4-89e2-78545ec636f3 service nova] Creating event network-vif-deleted:708f5f8a-a1dd-4aee-a3d9-93a24aa0d06f for instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd on hv-cinder-79760 Jun 30 15:52:26.920553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-6d585cbc-8bea-4377-9cb0-67b7465ae61c req-f6a35f8e-8ab8-4cf4-89e2-78545ec636f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031257 Jun 30 15:52:26.921910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 141/285] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:52:27.048736 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:27.058706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-829bd47f-c1eb-4307-9990-aa5123743387 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1504 microversion: 2.1 time: 0.179704 Jun 30 15:52:27.059750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 145/286] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:26 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:27.425787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:27.426491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:27.433281 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:27.433774 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:27.434540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:27.434974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:27.574877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:27.582550 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b4f876f0-6638-480c-9963-cbb1dbf5ed9d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.161510 Jun 30 15:52:27.583127 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 142/287] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:27 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:27.735025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:27.735657 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:27.745276 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:27.745701 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:27.746517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:27.747551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:27.813895 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:27.821944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4aed8fc5-93d6-43af-8ab8-5ce9194973d0 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1427 microversion: 2.1 time: 0.090630 Jun 30 15:52:27.822890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 146/288] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:27 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:28.078812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:28.079405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:28.085652 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.086095 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.086857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.087289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.235512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:28.243666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-67573ef0-9820-42e5-83bb-2ed8baca8c14 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1504 microversion: 2.1 time: 0.168728 Jun 30 15:52:28.244275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 143/289] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:28 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:28.599710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:28.600349 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:28.606441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.606883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.607633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.608063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.749615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:28.757385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ec876cc9-80ef-411b-a636-b0eae6ecfc3d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1522 microversion: 2.1 time: 0.161580 Jun 30 15:52:28.757984 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 147/290] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:28 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:28.839199 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:28.839855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:28.850373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.850373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.850373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:28.850373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:28.914587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:28.922632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-638708aa-e082-486f-83e8-4bc280983840 tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1427 microversion: 2.1 time: 0.087600 Jun 30 15:52:28.923395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 144/291] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:28 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:29.260505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:29.261119 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:29.268019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.268466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.269234 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.269837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.408384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:29.415921 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-909d7b37-9ce5-43f6-8bb3-c451db4cfb06 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1504 microversion: 2.1 time: 0.159528 Jun 30 15:52:29.416526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 148/292] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:29 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:29.774341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:29.774951 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:29.781161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.781647 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.782529 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.782958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.939606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:29.940342 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:29.946879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.947318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.948129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.948550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.979980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:29.980480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:29.980922 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lazy-loading 'fault' on Instance uuid 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:52:30.050348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b4682563a24786804dee37d5ee31eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac1871137494335b9cee22170d3315b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:30.053796 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:30.058560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-efbca0aa-9ed3-45da-9d6d-88fbc69a1dcb tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 200 len: 1304 microversion: 2.1 time: 0.122636 Jun 30 15:52:30.059311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 149/293] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:29 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:30.062842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-26450eef-dccd-4248-ba1f-45262a6d33a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1502 microversion: 2.1 time: 0.292334 Jun 30 15:52:30.063592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 145/294] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:29 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:30.079032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:30.079633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:30.085752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:30.086196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:30.086924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:30.087361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:30.305589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:30.316221 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1f408a25-03ab-477d-9170-570b7cf0aba0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1515 microversion: 2.1 time: 0.240974 Jun 30 15:52:30.317327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 150/295] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:30 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:30.433355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:30.434335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:30.440984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:30.441636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:30.442561 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:30.443155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:30.540910 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-34f1497f-f4cb-4869-91be-867519c78b48 req-bb5fbb95-07d3-401b-af8c-6d1b29ed91e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dfbcbe-8e35-4920-96c5-b678d77b673e", "name": "network-vif-deleted", "tag": "e963f24a-c9f7-4861-986b-748baeda12ad"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:30.548697 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17123d3e5fe945bbb1cb835f154965d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4585e1e7524dd78f3cf187684ee2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:30.553352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-34f1497f-f4cb-4869-91be-867519c78b48 req-bb5fbb95-07d3-401b-af8c-6d1b29ed91e5 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:30.556692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-34f1497f-f4cb-4869-91be-867519c78b48 req-bb5fbb95-07d3-401b-af8c-6d1b29ed91e5 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:30.564944 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c2e9a344-2e74-465a-aa16-76e0e5982e73 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 200 len: 1462 microversion: 2.1 time: 0.135429 Jun 30 15:52:30.578761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-34f1497f-f4cb-4869-91be-867519c78b48 req-bb5fbb95-07d3-401b-af8c-6d1b29ed91e5 service nova] Creating event network-vif-deleted:e963f24a-c9f7-4861-986b-748baeda12ad for instance 73dfbcbe-8e35-4920-96c5-b678d77b673e on hv-cinder-79760 Jun 30 15:52:30.579427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-34f1497f-f4cb-4869-91be-867519c78b48 req-bb5fbb95-07d3-401b-af8c-6d1b29ed91e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Jun 30 15:52:30.579666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 146/296] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:30 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 1462 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:30.579953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 151/297] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:31.080250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:31.081273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] [instance: 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:31.092355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.092805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.093606 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.094355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.109686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] HTTP exception thrown: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Request method failure captured: Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd HTTP/1.1 Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcabX5fgz5Fs5X0GvFjGpYwi_6fMB1V-Y3mm-pE8xHikXSg4rGRBlpzmTB9owyQCLlC1aRV6521_Ou8DjsJAOQDIGrPPl-FYh10GxLlzjIZHmixwRttqp07Df4Ca1tANAH-QdDmZJKqo5WVq9E9DhogUIQgYpldzO3HOBylu7PF9ADQ Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 5ac1871137494335b9cee22170d3315b Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-VolumesNegativeTest-286336845 Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:52:31.111471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ac1871137494335b9cee22170d3315b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ac1871137494335b9cee22170d3315b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ac1871137494335b9cee22170d3315b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ac1871137494335b9cee22170d3315b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-VolumesNegativeTest-286336845 Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 5ac1871137494335b9cee22170d3315b Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-VolumesNegativeTest-286336845 Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-VolumesNegativeTest-286336845-project Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: f2b4682563a24786804dee37d5ee31eb Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-VolumesNegativeTest-286336845-project Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. Jun 30 15:52:31.114555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '20c932da-4e7a-4456-ab3b-6eb3fe6a34bd'} Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:52:31.115280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. Jun 30 15:52:31.116544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.119108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] Returning 404 to user: Instance 20c932da-4e7a-4456-ab3b-6eb3fe6a34bd could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:52:31.119108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6be9d05a-38cd-4047-9124-3c1632ac567f tempest-VolumesNegativeTest-286336845 tempest-VolumesNegativeTest-286336845-project] 10.222.0.50 "GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd" status: 404 len: 111 microversion: 2.1 time: 0.037403 Jun 30 15:52:31.119108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 147/298] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:31 2022] GET /compute/v2.1/servers/20c932da-4e7a-4456-ab3b-6eb3fe6a34bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:52:31.589240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:31.590109 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] [instance: 73dfbcbe-8e35-4920-96c5-b678d77b673e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:31.596766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.597203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.597947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.598555 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.613475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] HTTP exception thrown: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Request method failure captured: Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e HTTP/1.1 Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcaDNrZjwgCwliropO6FDzi7pRk2TgjX1ASjWjbGjuXQpaycmXs30IGv-DiiAT45LDPp0t7XbiKXcKar7taqfjxOANK5LcLLiJctVoETdo6KuVGQisrYQvtUNAKZolzMxLZIpWoLiYA1dauLHBNoljHIv_II3Gsu1-W8NVw_4VloS-E Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: cd4585e1e7524dd78f3cf187684ee2ba Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesActionsTest-230151630 Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:52:31.618134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd4585e1e7524dd78f3cf187684ee2ba", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd4585e1e7524dd78f3cf187684ee2ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesActionsTest-230151630 Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: cd4585e1e7524dd78f3cf187684ee2ba Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesActionsTest-230151630 Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesActionsTest-230151630-project Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 17123d3e5fe945bbb1cb835f154965d4 Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesActionsTest-230151630-project Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. Jun 30 15:52:31.619517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '73dfbcbe-8e35-4920-96c5-b678d77b673e'} Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:52:31.620467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. Jun 30 15:52:31.622058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:31.623434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] Returning 404 to user: Instance 73dfbcbe-8e35-4920-96c5-b678d77b673e could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:52:31.623434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6c860acc-ba18-434b-8b43-8c8e77f050a1 tempest-VolumesActionsTest-230151630 tempest-VolumesActionsTest-230151630-project] 10.222.0.50 "GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e" status: 404 len: 111 microversion: 2.1 time: 0.036923 Jun 30 15:52:31.623434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 152/299] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:31 2022] GET /compute/v2.1/servers/73dfbcbe-8e35-4920-96c5-b678d77b673e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:52:31.731924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:31.732877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:31.739247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.739693 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.740502 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.740941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.764856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'flavor' on Instance uuid 4019fc09-23bd-4909-9804-4c685e180031 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:52:31.879509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5908cbb7-cd03-4a70-9346-60417b620523 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/action" status: 200 len: 32 microversion: 2.1 time: 0.151452 Jun 30 15:52:31.883114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 148/300] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:52:31 2022] POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:52:31.889169 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:31.889785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:31.900058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.900656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:31.901566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:31.901972 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:32.139712 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:32.148278 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1e28fe36-3de0-4d84-926e-a9cb0bc2261b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.262709 Jun 30 15:52:32.149278 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 153/301] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:31 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:33.167157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:33.167717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:33.169699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:33.176629 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:33.177078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:33.177846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:33.178267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:33.315886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:33.323910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f3c2775e-fd2e-4e9f-a3d9-6bef70967f87 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.161846 Jun 30 15:52:33.324503 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 149/302] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:33 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:34.342040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:34.342724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:34.349618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:34.350066 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:34.350830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:34.351239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:34.485715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:34.494454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5d019ba3-df01-463e-bb83-16864edac7c1 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.156839 Jun 30 15:52:34.495678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 154/303] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:34 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:35.512210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:35.512814 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:35.519540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:35.520011 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:35.520796 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:35.521224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:35.661459 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:35.669707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cf50e47a-21b3-41a6-a6ab-97ac5d6bfe8f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.161402 Jun 30 15:52:35.670265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 150/304] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:35 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:36.687406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:36.688094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:36.690162 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:36.696449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:36.696897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:36.697644 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:36.698070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:36.828295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:36.837666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-908345ea-1042-44d5-863c-806105d8619e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.152774 Jun 30 15:52:36.837666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 155/305] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:36 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:37.853055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:37.853650 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:37.862133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:37.862890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:37.863635 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:37.864059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:37.996386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:38.004054 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-271c141b-3962-416d-9a5c-28897f780ce3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.155030 Jun 30 15:52:38.004609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 151/306] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:37 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:39.021851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:39.022699 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:39.027848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:39.028343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:39.029234 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:39.029742 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:39.030580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:39.031229 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:39.035244 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:39.035946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:39.036729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:39.037155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:39.060525 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-70a8b92f-275b-46e3-8394-a4d7a0dac29a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/ips" status: 200 len: 153 microversion: 2.20 time: 0.036669 Jun 30 15:52:39.061093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 152/307] 10.222.0.50 () {60 vars in 1288 bytes} [Thu Jun 30 15:52:39 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 15:52:39.189700 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:39.198856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c5947de8-ac5c-43f7-9ee2-09064d304fc0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.181418 Jun 30 15:52:39.199807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 156/308] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:39 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:40.218107 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:40.218956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:40.226230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:40.226230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:40.226913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:40.227345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:40.376571 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:40.384895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-096ed6ca-d1d4-4fff-89ec-3d15afc96346 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.171479 Jun 30 15:52:40.385734 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 153/309] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:40 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:41.402241 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:41.403611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:41.413523 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:41.413918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:41.414901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:41.415500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:41.706725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:41.715856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9f6994f9-ae82-4b6f-9fb5-715e14f7d540 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.317417 Jun 30 15:52:41.716961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 157/310] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:41 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:42.034243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:42.035893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:42.053592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:42.054287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:42.055300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:42.055916 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:42.082528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-eb474071-072c-4110-b557-03a41c24840b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/ips" status: 200 len: 147 microversion: 2.1 time: 0.052842 Jun 30 15:52:42.083106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 154/311] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 15:52:42 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:42.738158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:42.739475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:42.747968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:42.748700 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:42.749619 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:42.750191 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:42.988586 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:42.997713 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0407be3f-c67f-4f7c-9141-9211e36f3e75 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.264211 Jun 30 15:52:42.998932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 158/312] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:42 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:43.874025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:43.875261 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:43.882777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:43.883494 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:43.884467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:43.885053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:43.946056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lazy-loading 'flavor' on Instance uuid 049d6e85-38af-4704-9533-28e68f38451c {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:52:44.018750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:44.019381 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:44.023165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:44.025712 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:44.026361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:44.027332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:44.028050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:44.547226 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:44.563877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a4906cdb-31bf-4100-ae72-9e59bcbd574d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.549091 Jun 30 15:52:44.564781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 159/313] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:44 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:45.586055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:45.586763 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:45.596370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:45.597024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:45.600518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:45.607611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:45.874065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:45.887063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9766788b-4600-444e-9363-ac471c308dfd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.309343 Jun 30 15:52:45.888012 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 160/314] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:45 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:46.915258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:46.916278 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:46.922227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:46.922744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:46.923419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:46.923840 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:46.941696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:52:47.231530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:47.248080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ebeec55d-f4a6-4809-adfd-e92d82797bb0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.336854 Jun 30 15:52:47.249673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 161/315] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:46 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:47.651341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f636ef23-138b-4b1f-b424-fc1f2b4e0d2d"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:47.652548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:47.660122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:47.660848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:47.661790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:47.662464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:48.204200 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-75bc2785-0c65-4611-b760-4e703c0c3ef2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556552 Jun 30 15:52:48.208399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 162/316] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:52:47 2022] POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:52:48.282881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:48.283621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:48.307466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:48.311785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:48.312686 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:48.323726 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:48.673295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:48.688210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-18dc4bdd-1921-40d2-8189-3d06fd7700aa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.412293 Jun 30 15:52:48.690477 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 163/317] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:48 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:49.710301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:49.711389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:49.718365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:49.720577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:49.722081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:49.723359 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:50.069839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:50.082479 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-578e06ee-5c76-4ab6-9844-741d8031b4a3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.376270 Jun 30 15:52:50.092788 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 164/318] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:49 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:51.114195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:51.117047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:51.130302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:51.131293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:51.132849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:51.135824 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:51.488850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:51.504591 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-36e1f0aa-13f9-421e-aee8-2f14dd05c440 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.408906 Jun 30 15:52:51.506134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 165/319] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:51 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:52.441101 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1f724ec9-7d6f-49ec-a19b-5b94c8313314 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/action" status: 202 len: 0 microversion: 2.20 time: 8.569991 Jun 30 15:52:52.458313 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 155/320] 10.222.0.50 () {62 vars in 1318 bytes} [Thu Jun 30 15:52:43 2022] POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/action => generated 0 bytes in 8589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:52:52.478152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:52.480917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:52.504711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:52.505474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:52.511144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:52.513023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:52.529772 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:52.532881 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:52.545275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:52.548608 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:52.549645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:52.550270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:52.826261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:52.836440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:52.842583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:52.849490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ff24c42b-59dc-4270-aed0-6ed153ff8b8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.380421 Jun 30 15:52:52.850530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 166/321] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:52:52 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:52:52.930170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:52.938634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-165127d5-48ab-46a8-80a4-f21f6bc71ec7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.419420 Jun 30 15:52:52.949742 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 156/322] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:52 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:53.873889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:53.874413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:53.891352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:53.894656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:53.895711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:53.896403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:53.956365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:53.958184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:53.972444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:53.973358 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:53.974280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:53.974702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:54.396320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:54.411199 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:54.435441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:54.440949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-033820ff-cf77-41d1-a62c-c35d6f732997 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.474026 Jun 30 15:52:54.442050 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 157/323] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:53 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:54.444948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:54.447141 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9450014d-f0bb-44b6-bff3-8fc321b9ef83 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.582050 Jun 30 15:52:54.452664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 167/324] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:52:53 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:52:55.460436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:55.461048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:55.470007 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:55.471224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:55.478273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:55.478724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:55.479563 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:55.480060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:55.494501 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:55.494979 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:55.495771 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:55.496232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:56.221360 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:56.231010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d20c48cb-dc5c-4451-b6bc-38030cab3af9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.774381 Jun 30 15:52:56.242801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 158/325] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:55 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:56.298707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:56.307567 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:56.309081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:56.310218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-715cb525-8253-4fa1-8dd2-8244172c0826 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.844096 Jun 30 15:52:56.328079 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 168/326] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:52:55 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:52:56.343115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7ffb7fdd-5f89-4dec-a6b7-b21f4bd34cbd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:56.351268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ffb7fdd-5f89-4dec-a6b7-b21f4bd34cbd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:56.352224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ffb7fdd-5f89-4dec-a6b7-b21f4bd34cbd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:56.421366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7ffb7fdd-5f89-4dec-a6b7-b21f4bd34cbd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Going to try to stop instance {{(pid=129450) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 15:52:56.478455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7ffb7fdd-5f89-4dec-a6b7-b21f4bd34cbd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action" status: 202 len: 0 microversion: 2.1 time: 0.139288 Jun 30 15:52:56.480184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 159/327] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:52:56 2022] POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:52:56.488502 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:56.489844 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:56.496082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:56.496527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:56.497305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:56.503828 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:56.747859 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:56.758284 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c6fb140a-1b0e-46bd-a9ba-941417ef8d67 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.274065 Jun 30 15:52:56.759300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 169/328] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:56 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:57.274385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:57.275157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:57.296430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.296876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.306953 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.309135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.330161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:57.330755 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:57.350516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.351143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.352218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.353092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.626409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:57.629949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:57.638716 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9047763b-b22c-415e-963d-c2cfb32750e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.386379 Jun 30 15:52:57.642039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:57.645443 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:57.648664 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 160/329] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:57 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:57.649682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-99cbf6aa-94e6-43aa-b30c-2ca3af8b3250 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.323858 Jun 30 15:52:57.652042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 170/330] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:52:57 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:52:57.779970 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:57.780621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:57.801568 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.802023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.802811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:57.803247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:57.991104 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-626dd262-692b-4880-9b59-e147bda58516 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Action: 'create', calling method: .version_select at 0x7fbbdb337dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-457533439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKjuoYi5s0UjQ22GUZZ3gn17gzkgvzbO6IjukZh8gUD7M99kGES/ybSRf9Zbo7HYLMLERxfTC9t7sXEcOiacNEzgmWLCEwY7wvQ2/K9z4FhdFn4vS5cqSWzjWE9b2kwig=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:58.042641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-626dd262-692b-4880-9b59-e147bda58516 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for project affc1e688df04803bb823ccadf904c0a. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:52:58.053747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-626dd262-692b-4880-9b59-e147bda58516 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for user 2de768b55f9a495295113de2ce1279e5 and project affc1e688df04803bb823ccadf904c0a. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:52:58.095051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:58.105609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dc02d540-9fdf-46a4-966e-6c0a8566ea2e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.332700 Jun 30 15:52:58.107048 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 171/331] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:57 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:52:58.142539 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-626dd262-692b-4880-9b59-e147bda58516 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.479332 Jun 30 15:52:58.143243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 161/332] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:52:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:52:58.657834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:58.657834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:58.663087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:58.663806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:58.664782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:58.665533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:58.673374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:58.674656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:58.694935 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:58.696224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:58.697882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:58.700458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:58.981232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:58.993105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8cce90c5-4d9b-455e-a93e-a107b03dc9f7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1501 microversion: 2.1 time: 0.340837 Jun 30 15:52:59.005508 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:59.016197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 172/333] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:58 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:59.020184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:59.023853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:59.025332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-378d1bbb-23be-47a8-8fe9-6133de243ef6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.360090 Jun 30 15:52:59.040258 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 162/334] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:52:58 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:52:59.042153 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb6153a6-acf0-43bc-9991-dd073f5026b1"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:59.043788 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:59.059748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.060506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.061577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.062446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.099106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] HTTP exception thrown: Cannot 'attach_volume' instance 4019fc09-23bd-4909-9804-4c685e180031 while it is in vm_state rescued Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Request method failure captured: Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/os-volume_attachments HTTP/1.1 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 74 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZYVFSuUAxleG2k0a2OCamkz_RJtaY2Xq_DcljXOX2BcWa9SjeOxPb0obPYXgsefIxFkMfdwDV6nV6A8foadrrliK_obQfc2oAEj59w_Ahyk4C5lCCl3iEtB4l4C4Wagpi_bez67k_6QS6tcppzZISAD3XwBi0TxnHwznocqiCtYIs Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:52:59.101323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01a8c235ed97450bb8518af9d7dc1983", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: d30ffdb0374c4600a09476cfb3a07cb4 Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {"volumeAttachment": {"volumeId": "fb6153a6-acf0-43bc-9991-dd073f5026b1"}} Jun 30 15:52:59.104600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Cannot 'attach_volume' instance 4019fc09-23bd-4909-9804-4c685e180031 while it is in vm_state rescued Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'server_id': '4019fc09-23bd-4909-9804-4c685e180031', 'body': {'volumeAttachment': {'volumeId': 'fb6153a6-acf0-43bc-9991-dd073f5026b1'}}} Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4019fc09-23bd-4909-9804-4c685e180031 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:52:59.105498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4019fc09-23bd-4909-9804-4c685e180031 while it is in vm_state rescued Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:52:59.106946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4019fc09-23bd-4909-9804-4c685e180031 while it is in vm_state rescued Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Returning 409 to user: Cannot 'attach_volume' instance 4019fc09-23bd-4909-9804-4c685e180031 while it is in vm_state rescued {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bd50c095-7a87-4392-a265-e766216b3e0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073249 Jun 30 15:52:59.109918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 173/335] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:52:59 2022] POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 15:52:59.113678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:52:59.114482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:59.124509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.125491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.126886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.127538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.135907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:59.136667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:59.145670 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.146123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.146900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.147335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.249396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3e9ef294-e0f3-41a3-bb85-1b32c40d4d15 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/action" status: 202 len: 0 microversion: 2.1 time: 0.140798 Jun 30 15:52:59.250950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 163/336] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:52:59 2022] POST /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:52:59.262300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:52:59.263010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:52:59.294398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.294850 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.295629 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:52:59.303517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:52:59.751039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:59.770491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c898271d-04eb-442d-ac00-d2083429c31a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.643420 Jun 30 15:52:59.772810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 174/337] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:59 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:52:59.838479 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:52:59.853335 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-12dd20d3-bc3b-4302-b71e-80170348c941 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1509 microversion: 2.1 time: 0.597613 Jun 30 15:52:59.856324 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 164/338] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:52:59 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1509 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:00.052364 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:00.053276 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:00.071322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.072035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:00.073089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.073748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:00.492039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:00.506952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:00.508489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:00.509677 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2c3b4e99-c274-4e53-82b5-e337afb1dd4e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.469624 Jun 30 15:53:00.511938 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 175/339] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:00 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:00.789757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:00.790380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:00.799562 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.800994 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:00.803775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.804350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:00.873771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:00.874959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:00.902511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.902956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:00.903733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:00.904217 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:01.306497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:01.317026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2cf222ef-d6a0-4355-80de-d1a3e3b5ef7a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.531104 Jun 30 15:53:01.317606 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 165/340] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:00 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:01.380456 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:01.387711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:01.391502 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b30ec898-016c-45da-8848-68d965b89e67 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1509 microversion: 2.1 time: 0.521643 Jun 30 15:53:01.402795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 176/341] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:00 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:01.533692 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:01.534636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:01.565164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:01.565913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:01.567582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:01.568543 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:01.844171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:01.856472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:01.857990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:01.859189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9dcb36ef-7466-4730-97d6-75d93496f4ee tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.335274 Jun 30 15:53:01.860028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 166/342] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:01 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:02.334846 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:02.335463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:02.343433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.343882 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:02.344975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.345568 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:02.410955 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:02.411591 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:02.417992 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.418436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:02.419193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.419615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:02.511599 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:02.520121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dcc33c5b-291c-4969-b829-1b3b35c810ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.189013 Jun 30 15:53:02.520666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 177/343] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:02 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:02.572113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:02.580040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c5b9285c-0b35-4914-b716-5bfa66d9c55b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1509 microversion: 2.1 time: 0.173089 Jun 30 15:53:02.580720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 167/344] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:02 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:02.878680 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:02.879284 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:02.886212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.886667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:02.887428 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:02.887856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:03.026837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:03.035135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:03.036677 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:03.037822 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4a11bab5-7de0-4985-87a9-ea8913e03c82 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.163131 Jun 30 15:53:03.038373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 178/345] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:02 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:03.539919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:03.540494 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:03.542987 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:03.548795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:03.549238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:03.549990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:03.550416 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:03.597608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:03.598202 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:03.605199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:03.605655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:03.606426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:03.606863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:03.737817 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:03.747517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f2089b75-4ce3-4285-bddb-c01c13a9e359 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.211615 Jun 30 15:53:03.748868 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 168/346] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:03 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:03.809696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:03.818293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-32760401-5c55-422f-8f34-5d5d63e3a915 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1509 microversion: 2.1 time: 0.224571 Jun 30 15:53:03.828776 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 179/347] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:03 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:04.057578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:04.058097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:04.065969 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.066570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.067567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.068203 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.220023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:04.233700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:04.235417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:04.237136 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c5a5b6a5-e0ef-4985-8f03-5124a9a20eb3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.184556 Jun 30 15:53:04.237766 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 169/348] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:04 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:04.765137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:04.765744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:04.773707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.774472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.775225 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.775662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.837728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:04.841168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:04.851368 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.852547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.853946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:04.854883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:04.882791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:04.964783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:04.975342 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bb36bded-2ae9-4ee3-bc07-e5eae1f8d7f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.214231 Jun 30 15:53:04.985597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 180/349] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:04 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:05.020317 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:05.028633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-02558ae9-5543-49ba-ab8f-34de676b7aaf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1509 microversion: 2.1 time: 0.195777 Jun 30 15:53:05.029121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 170/350] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:04 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:05.255163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:05.255749 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:05.262200 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:05.262644 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:05.263405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:05.263832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:05.413893 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:05.422478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:05.424351 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:05.425587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-60e6b9ad-445e-47e1-800b-eaacae5a4c8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.174265 Jun 30 15:53:05.426325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 181/351] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:05 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:05.996215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:05.998055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:06.007005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.007932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.009492 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.010174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.052685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:06.053517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:06.076394 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.080929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.081782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.085841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.235899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:06.245891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e46a07e8-74d4-4dec-aa9e-59e6d367f4e5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.256537 Jun 30 15:53:06.246959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 171/352] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:05 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:06.281249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:06.289662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7b76289b-8cd0-4d92-b28e-f1f61eb1c889 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1515 microversion: 2.1 time: 0.243591 Jun 30 15:53:06.290621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 182/353] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:06 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:06.445639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:06.447032 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:06.454446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.455151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.455737 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:06.456324 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:06.632292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:06.642770 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:06.644496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:06.645717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8284b60d-62ff-420a-a42c-a89418c2fc23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.205178 Jun 30 15:53:06.652225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 172/354] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:06 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:07.262692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:07.268810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:07.271802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=56 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:07.277381 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:07.277827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:07.278590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:07.279020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:07.433663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:07.441884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-10bd375d-82dd-4c43-996f-3aafade2b80d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.183020 Jun 30 15:53:07.442445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 183/355] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:07 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:07.664945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:07.668919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:07.676378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:07.676825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:07.677778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:07.678419 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:07.735348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0d165b11-6e9c-4cc3-b3a2-4c4e14519156 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: .version_select at 0x7fbbdce79700>, body: {"keypair": {"name": "tempest-keypair-1345713788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRMIewIPg7wPk1eUWVht+lBrPbZc7PoygiL+PRmT6KFmmUIPDbwl9mP3Wcgumgsfza5zBhC0Q0bsz4ZpCNDrdS8yP5v9152lxvgjQJEUcG7Ze4h6rBUniaEqX96ktWhZA=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:07.756500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-0d165b11-6e9c-4cc3-b3a2-4c4e14519156 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:07.761043 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-0d165b11-6e9c-4cc3-b3a2-4c4e14519156 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for user d30ffdb0374c4600a09476cfb3a07cb4 and project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:07.789827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0d165b11-6e9c-4cc3-b3a2-4c4e14519156 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058022 Jun 30 15:53:07.790425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 184/356] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:53:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:53:07.858860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:07.868489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:07.870092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:07.871639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7ed67189-4104-4d98-b509-ccd8a6dac94f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.210613 Jun 30 15:53:07.872500 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 173/357] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:07 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:08.459154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:08.459751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:08.472197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:08.472645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:08.473715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:08.474306 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:08.681136 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:08.693022 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0de990e8-6784-4bad-892a-db1e3cc1bd05 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.237958 Jun 30 15:53:08.694144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 185/358] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:08 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:08.892230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:08.892967 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:08.895207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=4 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:08.908023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:08.909168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:08.909573 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:08.910103 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:09.483585 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:09.495662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:09.498381 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:09.500770 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2203b00a-4237-48bf-881a-9d5ad0d217dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.613093 Jun 30 15:53:09.515325 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 174/359] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:08 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:09.711091 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:09.711704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:09.718555 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:09.719433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:09.721411 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:09.721994 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:09.891878 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:09.905378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-73fa6920-82ab-4d43-bffd-201c7a183efb tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.197951 Jun 30 15:53:09.906068 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 186/360] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:09 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:09.911219 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-639160312", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1b0598a-0f3d-45a8-b226-13dfd84b67db"}], "security_groups": [{"name": "tempest-securitygroup--1788377180"}], "key_name": "tempest-keypair-1345713788", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:10.332336 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] validate_networks() for [('f1b0598a-0f3d-45a8-b226-13dfd84b67db', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:53:10.522070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:10.522745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:10.529031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.529472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.530228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.530661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.758332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:10.769743 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:10.771506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:10.772701 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-707f88a6-6622-4bde-99a9-d69adea66bd6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.254647 Jun 30 15:53:10.773253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 187/361] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:10 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:10.783703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:53:10.784173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:53:10.784641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:53:10.785051 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:53:10.785455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:53:10.794739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.795182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.795972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.796435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.813674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:10.822641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Getting quotas for user d30ffdb0374c4600a09476cfb3a07cb4 and project 01a8c235ed97450bb8518af9d7dc1983. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:10.835214 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:53:10.837583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:53:10.887956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4429db1c-518a-497a-8112-9ed554b7872a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.981169 Jun 30 15:53:10.889327 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 175/362] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:53:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 15:53:10.900981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-321c7c34-0c7d-47b1-afe3-7db02afeae18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:10.901790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-321c7c34-0c7d-47b1-afe3-7db02afeae18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:10.922682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:10.923248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:10.932222 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.932670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.933661 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:10.934392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:10.977611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-321c7c34-0c7d-47b1-afe3-7db02afeae18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:10.986741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-321c7c34-0c7d-47b1-afe3-7db02afeae18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1245 microversion: 2.1 time: 0.090863 Jun 30 15:53:10.988264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 188/363] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:10 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:11.099678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:11.108662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-67548d1f-5640-44c0-8c19-5320e6b54f7c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.189773 Jun 30 15:53:11.109873 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 176/364] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:10 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:11.791029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:11.791850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:11.800783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:11.801320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:11.802173 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:11.802762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:11.977673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:11.988964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:11.990956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:11.993656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a83cdbe1-286d-4a57-b730-b7ef65c7f8dc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.206509 Jun 30 15:53:11.994350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 189/365] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:11 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:12.004145 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:12.005100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:12.016015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:12.018286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:12.022588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:12.023061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:12.136484 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:12.137377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:12.142169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:12.165210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ea6f9d45-6176-49a8-8ced-5605872b5469 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1305 microversion: 2.1 time: 0.165368 Jun 30 15:53:12.168315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:12.168971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:12.173359 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 177/366] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:11 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1305 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:12.180525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:12.181236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:12.451507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:12.460385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e240759e-1a7b-4723-b143-02ea4fee57b9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1726 microversion: 2.1 time: 0.334692 Jun 30 15:53:12.461551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 190/367] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:12 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1726 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:13.013386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:13.013995 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:13.024601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.025042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.025812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.026240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.189609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:13.190228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:13.200816 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.201798 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.203370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.204208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.347085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:13.365560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:13.367205 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:13.368289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3662424d-a5e5-41a5-96de-5a6fa7bf0cec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.359341 Jun 30 15:53:13.369128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 178/368] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:13 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:13.478069 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:13.478925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:13.497731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.499054 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.500047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.500788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:13.728252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:13.737377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6e949ec9-41a3-483e-a05c-2be06fec87dc tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.551259 Jun 30 15:53:13.737947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 191/369] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:13 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:13.863218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:13.873049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2c5adca5-9cae-4885-afa5-5f46f361b923 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1703 microversion: 2.1 time: 0.398653 Jun 30 15:53:13.873846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 179/370] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:13 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1703 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:13.890006 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-04c3b1c2-6ee7-4cbb-9f85-f2ed57789633 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:13.896479 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04c3b1c2-6ee7-4cbb-9f85-f2ed57789633 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:13.897055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-04c3b1c2-6ee7-4cbb-9f85-f2ed57789633 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.005725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-04c3b1c2-6ee7-4cbb-9f85-f2ed57789633 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Going to try to start instance {{(pid=129449) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 15:53:14.100707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-04c3b1c2-6ee7-4cbb-9f85-f2ed57789633 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action" status: 202 len: 0 microversion: 2.1 time: 0.211971 Jun 30 15:53:14.104144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 192/371] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:53:13 2022] POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:53:14.112511 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:14.113174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:14.121438 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.122032 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.122827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.123432 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.387800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:14.389085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:14.396573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.397963 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.399300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.399786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.403410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:14.417133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b2be8ea8-17fe-426f-a2df-7c2cfdd1016f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1712 microversion: 2.1 time: 0.309914 Jun 30 15:53:14.418487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 180/372] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:14 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1712 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:14.596095 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-0a620198-a57a-46f6-b7e8-b5e678414755 req-3ad07060-b656-4af6-b799-ef9b1163f671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:14.621458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0a620198-a57a-46f6-b7e8-b5e678414755 req-3ad07060-b656-4af6-b799-ef9b1163f671 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.623115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0a620198-a57a-46f6-b7e8-b5e678414755 req-3ad07060-b656-4af6-b799-ef9b1163f671 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.638021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-0a620198-a57a-46f6-b7e8-b5e678414755 req-3ad07060-b656-4af6-b799-ef9b1163f671 service nova] Creating event network-changed:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:53:14.644393 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-0a620198-a57a-46f6-b7e8-b5e678414755 req-3ad07060-b656-4af6-b799-ef9b1163f671 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062731 Jun 30 15:53:14.646410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 181/373] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:14.755147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:14.755853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:14.763585 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.764013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.764789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:14.770409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:14.888099 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:14.903614 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:14.910135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:14.912662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d16d92af-a1c1-49d6-a020-71fc198483cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.529752 Jun 30 15:53:14.913246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 193/374] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:14 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:15.224393 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1989119790", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "networks": [{"uuid": "09974abb-d757-428e-a03c-d9046575cdd5"}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:15.238301 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:15.247148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9b2f1f43-264d-48a9-b825-84058510496e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.496087 Jun 30 15:53:15.248031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 182/375] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:14 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:15.285271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] validate_networks() for [('09974abb-d757-428e-a03c-d9046575cdd5', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:53:15.435093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:15.435707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:15.442438 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:15.442912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:15.443697 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:15.444169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.074669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.092835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5aeaafbe-e644-4331-8aa0-a6a9f4af1b37 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1712 microversion: 2.1 time: 0.661554 Jun 30 15:53:16.097536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 183/376] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:15 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1712 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:16.109875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:16.111189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:16.118653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.119355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.121369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.122366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.385106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.394446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.396267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.397524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8883dfa6-ddba-4119-a7d0-a19ff55ba73e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1746 microversion: 2.20 time: 0.298780 Jun 30 15:53:16.398198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 184/377] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:16 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1746 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:16.403109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:16.403718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:16.414931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.415395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.416950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.417322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.419009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:53:16.419784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:53:16.419948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:53:16.420340 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:53:16.420754 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:53:16.435002 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.435447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.436274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:16.436710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:16.455626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Getting quotas for project cf17d9690bf54b98815f00334a3470bc. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:16.459874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Getting quotas for user b9a7593adca849d49a95cec18d31ee14 and project cf17d9690bf54b98815f00334a3470bc. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:16.476196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:53:16.478610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:53:16.535161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b4dc323e-befe-4065-b313-e4b39f0d8c31 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314534 Jun 30 15:53:16.536516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 194/378] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:53:16.547825 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d80b9c24-518a-4f7f-91a0-52e94d0247e5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:16.548688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d80b9c24-518a-4f7f-91a0-52e94d0247e5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:16.567226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.575585 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-270d7c5a-28e3-41c6-98fe-f617cb6cf8e3 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.176028 Jun 30 15:53:16.576525 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 185/379] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:16 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:16.606378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d80b9c24-518a-4f7f-91a0-52e94d0247e5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:16.614883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d80b9c24-518a-4f7f-91a0-52e94d0247e5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1219 microversion: 2.1 time: 0.072142 Jun 30 15:53:16.615965 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 195/380] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:16 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:17.113519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:17.114138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:17.120458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.120911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.121713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.122147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.348467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.358815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-656ada10-3a20-496a-b3ab-6f94f7c77d35 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1712 microversion: 2.1 time: 0.249574 Jun 30 15:53:17.359478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 186/381] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:17 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1712 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:17.417396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:17.418061 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:17.425276 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.425978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.426651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.427185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.432645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:17.578530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.587301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.589427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.590742 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6707fff0-e2d3-435b-a788-f8375a8df02c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1746 microversion: 2.20 time: 0.178086 Jun 30 15:53:17.591302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 196/382] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:17 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:17.595395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:17.596033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:17.613680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.614465 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.615462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.616261 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.635587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:17.635587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:17.642732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.643206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.644290 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:17.644624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:17.807456 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.820079 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-460aeb3d-05d9-457e-bff3-34fb3f19a9e4 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1223 microversion: 2.1 time: 0.190434 Jun 30 15:53:17.821282 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 197/383] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:17 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1223 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:17.878739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:17.890291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-bc094268-cc3d-45e3-870b-52416f915979 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.301293 Jun 30 15:53:17.891223 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 187/384] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:17 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:18.376823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:18.378189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:18.386608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.391571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.394270 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.397099 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.609184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:18.609786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:18.622140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.622815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.623774 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.624374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.628580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:18.641016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-70d39549-04da-4cfc-bf4f-2609757ecb1e tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1716 microversion: 2.1 time: 0.267989 Jun 30 15:53:18.652314 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 198/385] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:18 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1716 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:18.654292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:18.774225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:18.782517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:18.784048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:18.785245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5008e990-e8f2-4dd0-8135-4dfb5dc860b2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1746 microversion: 2.20 time: 0.180328 Jun 30 15:53:18.785804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 188/386] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:18 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:18.836739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:18.837338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:18.844212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.844997 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.845968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.846583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.907403 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:18.908516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:18.915968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.916536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.917679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:18.918243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:18.965325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:18.977424 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8468be60-8c02-45fb-b59d-27b784432b33 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1271 microversion: 2.1 time: 0.144425 Jun 30 15:53:18.979273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 199/387] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:18 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:19.280970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:19.294229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2860b687-2122-4def-a57b-502f85834cf9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.390692 Jun 30 15:53:19.301045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 189/388] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:18 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:19.516744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-e8706784-57e3-4385-95b0-bd435e5a6fe3 req-57b848a3-c80d-407b-90a0-04da7720915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "name": "network-vif-plugged", "status": "completed", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:19.530786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-e8706784-57e3-4385-95b0-bd435e5a6fe3 req-57b848a3-c80d-407b-90a0-04da7720915a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:19.546883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-e8706784-57e3-4385-95b0-bd435e5a6fe3 req-57b848a3-c80d-407b-90a0-04da7720915a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:19.565617 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-e8706784-57e3-4385-95b0-bd435e5a6fe3 req-57b848a3-c80d-407b-90a0-04da7720915a service nova] Creating event network-vif-plugged:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:53:19.583906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-e8706784-57e3-4385-95b0-bd435e5a6fe3 req-57b848a3-c80d-407b-90a0-04da7720915a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071216 Jun 30 15:53:19.585480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 200/389] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:19.808023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:19.808844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:19.819002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:19.832656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:19.834949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:19.836594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:20.000279 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:20.000992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:20.009765 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:20.010383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:20.011261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:20.012842 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:20.196063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:20.204630 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7cc70f51-f4f7-4efe-aa4b-450765fc0233 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1277 microversion: 2.1 time: 0.213493 Jun 30 15:53:20.212610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 201/390] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:19 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:20.318654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:20.319566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:20.330423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:20.339185 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:20.349158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:20.351468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:20.352185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:20.353168 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:20.353797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:20.355198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1c9a5ccb-f082-495d-90d2-9e847442cfaa tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.556497 Jun 30 15:53:20.361164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 190/391] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:19 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:20.712402 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:20.722902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b8e22eba-f418-4418-a050-cb2cdc41788f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.409564 Jun 30 15:53:20.723482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 202/392] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:20 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:21.229289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:21.229908 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:21.238963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:21.240726 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:21.248190 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:21.249513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:21.253138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:21.253781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:21.378806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:21.379393 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:21.387911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:21.395538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:21.396604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:21.397053 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:21.999599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:22.011166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6dee6e45-2317-4f63-b736-8ea1f1dc0148 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 0.788234 Jun 30 15:53:22.016567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 191/393] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:21 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:22.040820 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:22.043213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:22.085517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:22.094575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:22.095566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:22.096686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:22.097322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:22.098564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:22.100107 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:22.101277 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8355cce5-bd51-4fbb-87b5-718ef68691a8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.726544 Jun 30 15:53:22.106803 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 203/394] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:21 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:22.111879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-928019906", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457533439", "security_groups": [{"name": "tempest-secgroup-smoke-690202865"}], "block_device_mapping_v2": [{"uuid": "c8af0421-91ef-488a-8b25-5e48de50c3dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "33f28908-5ff2-4a8b-a553-d1f2fd3a4df7"}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:22.560066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:22.574036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-697c3c64-e72c-4ca5-9a77-a86f4ef48c0c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.555571 Jun 30 15:53:22.576284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 192/395] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:22 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:22.581521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-50ea1765-16ac-448e-b9a5-71e922a2de6d req-ca84d4bd-1788-4749-81ed-10762819cffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "name": "network-vif-plugged", "status": "completed", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:22.592181 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-50ea1765-16ac-448e-b9a5-71e922a2de6d req-ca84d4bd-1788-4749-81ed-10762819cffe service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:22.592884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-50ea1765-16ac-448e-b9a5-71e922a2de6d req-ca84d4bd-1788-4749-81ed-10762819cffe service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:22.608832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-50ea1765-16ac-448e-b9a5-71e922a2de6d req-ca84d4bd-1788-4749-81ed-10762819cffe service nova] Creating event network-vif-plugged:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:53:22.615718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-50ea1765-16ac-448e-b9a5-71e922a2de6d req-ca84d4bd-1788-4749-81ed-10762819cffe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038019 Jun 30 15:53:22.616633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 193/396] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:22.633995 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-8374bd9e-3a4c-4a26-a28f-8c77a5429a25 req-3abb57bc-a682-4864-8dce-2790d97cb18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73bd8d03-ca91-4e95-b39a-f2e7e59f9390", "tag": "c769317a-ed4e-478a-ad86-0b94d8afe6bf"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:22.647336 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] validate_networks() for [('33f28908-5ff2-4a8b-a553-d1f2fd3a4df7', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:53:22.664865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-8374bd9e-3a4c-4a26-a28f-8c77a5429a25 req-3abb57bc-a682-4864-8dce-2790d97cb18c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:22.665672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-8374bd9e-3a4c-4a26-a28f-8c77a5429a25 req-3abb57bc-a682-4864-8dce-2790d97cb18c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:22.681943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-8374bd9e-3a4c-4a26-a28f-8c77a5429a25 req-3abb57bc-a682-4864-8dce-2790d97cb18c service nova] Creating event network-changed:c769317a-ed4e-478a-ad86-0b94d8afe6bf for instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 on hv-cinder-79760 Jun 30 15:53:22.691392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-8374bd9e-3a4c-4a26-a28f-8c77a5429a25 req-3abb57bc-a682-4864-8dce-2790d97cb18c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072402 Jun 30 15:53:22.692581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 194/397] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:23.031195 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:23.031910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:23.045828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:23.046276 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:23.047059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:23.047497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:23.507722 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:23.517565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a99d83d9-e843-4d57-b617-524e72dc3545 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 0.490662 Jun 30 15:53:23.528063 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 195/398] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:23 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:23.544666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:23.545503 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:23.552648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:23.553405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:23.554366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:23.554850 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:23.949800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:23.962516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:23.967522 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:23.969424 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:53:23.969953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:53:23.970347 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:53:23.970761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:53:23.971240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:53:23.971845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-501c0960-4756-4ff8-b0be-a6a7cb66bcdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.441696 Jun 30 15:53:23.973259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 196/399] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:23 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:23.987816 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:23.995655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:23.998617 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:23.999251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.000248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:24.000819 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.004051 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:24.004487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.005392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:24.005805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.067508 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:24.093475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for user 2de768b55f9a495295113de2ce1279e5 and project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:24.311320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:53:24.313910 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8af0421-91ef-488a-8b25-5e48de50c3dd',volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:53:24.348097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:24.357650 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-54a8e5d9-b472-42b8-8222-da69b4e898ed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.382993 Jun 30 15:53:24.359631 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 197/400] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:23 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:24.536068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:24.536693 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:24.557023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:24.557472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.560401 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:24.568202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:24.607140 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-390a9ba3-513a-43ba-8121-094c310f070c tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.499173 Jun 30 15:53:24.611793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 204/401] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:53:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:53:24.629067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3da5451d-ce72-4be8-a563-1cdfd73bb689 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:24.630065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3da5451d-ce72-4be8-a563-1cdfd73bb689 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:24.885196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3da5451d-ce72-4be8-a563-1cdfd73bb689 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:24.897715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3da5451d-ce72-4be8-a563-1cdfd73bb689 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1093 microversion: 2.1 time: 0.282073 Jun 30 15:53:24.898777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 205/402] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:24 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1093 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:24.995199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:24.998860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:25.033861 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.034812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:25.037097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.037759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:25.131740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:25.157164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-451551d3-e8b2-4c2f-9b65-f878dad3b10e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 0.626116 Jun 30 15:53:25.157757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 198/403] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:24 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:25.376965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:25.378007 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:25.391116 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.393321 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:25.394793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.395717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:25.423805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:25.432715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:25.437797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:25.439334 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-31aa1540-5e5f-47b1-b8b5-98bda7918bd7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.451962 Jun 30 15:53:25.440667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 206/404] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:24 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:25.709429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:25.719275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-00992899-e531-496a-8c2c-f61fc3496d57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1371 microversion: 2.1 time: 0.347434 Jun 30 15:53:25.721506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 199/405] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:25 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:25.917108 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:25.917724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:25.928748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.929472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:25.930436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:25.931078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.007926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:26.017160 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6f0f5170-559d-43ac-92c3-72ed41345925 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1135 microversion: 2.1 time: 0.105024 Jun 30 15:53:26.018092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 207/406] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:25 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1135 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:26.174454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:26.175118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:26.187429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.187879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.188698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.202943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.458283 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:26.458897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:26.474240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.474694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.475470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.475918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.883082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:26.892625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-704ef2e0-154e-4d3d-88b8-ac135bb2a00b tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 0.722479 Jun 30 15:53:26.909810 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 200/407] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:26 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:26.943389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:26.949554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:26.962092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.966043 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:26.967165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:26.969557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.440759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:27.459866 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:27.462054 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:27.463283 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-57f25c50-17ec-40a3-9748-172016dc4576 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 1.009032 Jun 30 15:53:27.474662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 208/408] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:26 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:27.479806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:27.480771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:27.494908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.495864 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.496836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.497600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.508625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:27.531749 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c71dee6f-af14-4107-ab08-2341f58aa2a9 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1564 microversion: 2.1 time: 0.606823 Jun 30 15:53:27.546998 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 201/409] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:26 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1564 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:27.559308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:27.571235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:27.581021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.582545 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.584088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.585003 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.900138 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:27.915230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3831fd3a-5d3e-4e21-9b5e-1149b867a680 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1209 microversion: 2.1 time: 0.438096 Jun 30 15:53:27.916721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 209/410] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:27 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1209 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:27.927454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:27.928814 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:27.938704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:27.941013 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.941693 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:27.942792 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:27.943418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:28.884171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ad86c25c-bf82-4063-ba1f-4d2d5e28e966 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.335849 Jun 30 15:53:28.892483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 202/411] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:53:27 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-interface => generated 284 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:28.898161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:28.900049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:28.914213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:28.919279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:28.920499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:28.921149 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:29.300717 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:29.313134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9bd5bfff-0fbd-475b-9836-536d85185eed tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 1.394574 Jun 30 15:53:29.320510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 210/412] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:27 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:29.337145 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-2f1efb93-9b5c-4a10-bf84-93b8fc967dc1 req-f4dae09a-4a66-464b-982d-5404873cf2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bd8d03-ca91-4e95-b39a-f2e7e59f9390", "name": "network-vif-plugged", "status": "completed", "tag": "c769317a-ed4e-478a-ad86-0b94d8afe6bf"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:29.352270 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2f1efb93-9b5c-4a10-bf84-93b8fc967dc1 req-f4dae09a-4a66-464b-982d-5404873cf2d9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:29.352889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2f1efb93-9b5c-4a10-bf84-93b8fc967dc1 req-f4dae09a-4a66-464b-982d-5404873cf2d9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:29.366843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-2f1efb93-9b5c-4a10-bf84-93b8fc967dc1 req-f4dae09a-4a66-464b-982d-5404873cf2d9 service nova] Creating event network-vif-plugged:c769317a-ed4e-478a-ad86-0b94d8afe6bf for instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 on hv-cinder-79760 Jun 30 15:53:29.376163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-2f1efb93-9b5c-4a10-bf84-93b8fc967dc1 req-f4dae09a-4a66-464b-982d-5404873cf2d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053881 Jun 30 15:53:29.377606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 211/413] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:29.387810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:29.390190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:29.402587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:29.403239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:29.404268 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:29.404879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:29.623052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:29.633660 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-decaf425-7c63-4fa2-8b0a-c18171730009 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1197 microversion: 2.1 time: 0.254612 Jun 30 15:53:29.638413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 212/414] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:29 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:30.135612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:30.149601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:30.153844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:30.158048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-40e31539-4b8f-4674-9d11-3b9cce2bb405 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 1.264104 Jun 30 15:53:30.159754 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 203/415] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:28 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:30.346451 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:30.347081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:30.355458 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:30.362067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:30.366075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:30.367515 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:30.654873 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:30.655482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:30.672017 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:30.680025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:30.683387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:30.683834 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:31.280269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:31.299313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-43416779-15c8-4f28-b96c-39a5d98b8b3a tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1319 microversion: 2.1 time: 0.965066 Jun 30 15:53:31.300345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 213/416] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:30 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1319 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:31.305561 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:31.321404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:31.349299 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:31.357030 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:31.363100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:31.366543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:31.422256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:31.433270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2fc58ec1-f65b-4416-9161-85651b78d9ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.782156 Jun 30 15:53:31.437775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 204/417] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:30 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:32.095352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:32.104762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:32.109801 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:32.117465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-43904f96-b727-4b1a-be50-79efbb505aa7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.815828 Jun 30 15:53:32.138425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 214/418] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:31 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:32.316777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:32.317832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:32.334933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:32.336525 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:32.343822 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:32.344558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:32.449962 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:32.450575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:32.463184 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:32.470807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:32.471737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:32.474195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:33.853825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:33.862955 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:33.875717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1dfb8bdc-8800-4e79-a6e0-eef70d5d6b0f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1507 microversion: 2.1 time: 1.562669 Jun 30 15:53:33.876210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:33.884242 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3d646de9-613b-462f-9697-1388dfc922aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 1.436976 Jun 30 15:53:33.885434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 205/420] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:32 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1507 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:33.887419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 215/420] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:32 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:33.890300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:33.906067 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:33.924998 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:33.927274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:33.929163 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:33.930414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:33.931140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:34.152731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-c73153f7-6599-4463-9f2e-339dd8e2e0d9 req-e2b1d363-5de2-4c14-8016-de694aa4f15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b17294c-3c9b-481a-b90b-36b12e5d2c5a", "tag": "f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:34.177063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=4 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:34.196300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-c73153f7-6599-4463-9f2e-339dd8e2e0d9 req-e2b1d363-5de2-4c14-8016-de694aa4f15a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:34.197504 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-c73153f7-6599-4463-9f2e-339dd8e2e0d9 req-e2b1d363-5de2-4c14-8016-de694aa4f15a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:34.265631 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-c73153f7-6599-4463-9f2e-339dd8e2e0d9 req-e2b1d363-5de2-4c14-8016-de694aa4f15a service nova] Creating event network-changed:f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa for instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a on hv-cinder-79760 Jun 30 15:53:34.292586 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-c73153f7-6599-4463-9f2e-339dd8e2e0d9 req-e2b1d363-5de2-4c14-8016-de694aa4f15a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140975 Jun 30 15:53:34.293588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 216/421] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:34.902566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=22 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:34.910009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:34.910009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:34.953834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:34.954282 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:34.955058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:34.963284 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:35.085268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:35.094246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:35.124232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:35.132176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:35.133941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-40df991c-e3e5-4e72-b506-bbe67bd94080 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 1.247503 Jun 30 15:53:35.136952 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 206/422] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:33 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:35.606045 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:35.623591 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8239b1ce-cb70-4585-a325-d844eace42aa tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.722145 Jun 30 15:53:35.649259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 217/423] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:34 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:36.155121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:36.156464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:36.169556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:36.170204 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:36.171252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:36.172243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:36.412929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-7ffaf1e9-e1bc-4ca6-9faa-d5f0fda42cdd req-805d8a7a-b9d2-47f1-8928-65fd02cb1fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:36.447214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-7ffaf1e9-e1bc-4ca6-9faa-d5f0fda42cdd req-805d8a7a-b9d2-47f1-8928-65fd02cb1fa7 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:36.450048 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-7ffaf1e9-e1bc-4ca6-9faa-d5f0fda42cdd req-805d8a7a-b9d2-47f1-8928-65fd02cb1fa7 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:36.514650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-7ffaf1e9-e1bc-4ca6-9faa-d5f0fda42cdd req-805d8a7a-b9d2-47f1-8928-65fd02cb1fa7 service nova] Creating event network-changed:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:53:36.530353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-7ffaf1e9-e1bc-4ca6-9faa-d5f0fda42cdd req-805d8a7a-b9d2-47f1-8928-65fd02cb1fa7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134011 Jun 30 15:53:36.534791 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 218/424] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:53:36.645217 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:36.646193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:36.666386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:36.672890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:36.673958 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:36.676802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:36.711026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:36.720229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:36.734013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:36.735888 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4ea45298-f3d7-4fd7-8304-6f932cc8ff8c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.586368 Jun 30 15:53:36.750878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 207/425] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:36 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:37.120786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:37.132462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7505ef54-cbcb-49c7-89fb-3b26f51a4632 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.492078 Jun 30 15:53:37.136388 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 219/426] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:36 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:37.786783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:37.786783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:37.803835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:37.804308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:37.805566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:37.806156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:38.152979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:38.154265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:38.169795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:38.177283 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:38.179339 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:38.183716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:38.503283 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:38.518491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:38.525376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:38.526970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-79e72a6d-8845-423f-a931-1562fa049e37 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.772615 Jun 30 15:53:38.540867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 208/427] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:37 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:39.082698 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:39.095907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b2f4c211-81d2-4695-be2a-96693c5462cb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.945787 Jun 30 15:53:39.097038 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 220/428] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:38 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:39.558378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:39.559660 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:39.570162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:39.576100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:39.577202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:39.577794 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:40.040082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:40.061627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:40.068443 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:40.070825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b6204ffc-267a-4abe-941d-5668c8da0c60 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1741 microversion: 2.20 time: 0.517193 Jun 30 15:53:40.071815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 209/429] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:39 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1741 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:40.115089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:40.115712 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:40.123551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:40.124009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:40.133094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:40.133533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:40.335040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:40.346467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ce18fd8d-91d4-4ade-bdbb-297cc0900c9f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.234597 Jun 30 15:53:40.356404 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 221/430] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:40 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:41.089380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:41.090073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:41.097075 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:41.097842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:41.098680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:41.099172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:41.327131 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:41.335766 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:41.337807 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:41.339129 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e294b0f5-b4c7-433d-ad34-2fe281f394f5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1723 microversion: 2.20 time: 0.253782 Jun 30 15:53:41.348819 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 210/431] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:41 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:41.363259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:41.363867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:41.372811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:41.373258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:41.374032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:41.374459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:41.513395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:41.521757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1da84a1f-068d-4080-803f-474ac9e17720 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.162806 Jun 30 15:53:41.522321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 222/432] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:41 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:42.359020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:42.360716 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:42.368461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:42.368919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:42.369689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:42.370185 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:42.527673 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:42.539352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:42.540523 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:42.542168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:42.542373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:42.543684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8e975123-be9c-4265-8186-5d45f8013b88 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1723 microversion: 2.20 time: 0.188885 Jun 30 15:53:42.544933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 211/433] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:42 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:42.553894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:42.554659 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:42.555664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:42.556337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:42.706653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:42.715067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ceb303c3-d411-42ab-a04c-bc301db91e6b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.180043 Jun 30 15:53:42.725326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 223/434] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:42 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:43.566191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:43.568136 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:43.575289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:43.576018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:43.576894 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:43.580208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:43.732584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:43.733790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:43.743722 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:43.744610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:43.745676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:43.746347 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:44.081832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:44.092345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:44.094124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:44.095705 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2e7eca43-476d-4487-ae5a-2e252f08f56f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1723 microversion: 2.20 time: 0.536687 Jun 30 15:53:44.096789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 212/435] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:43 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:44.128304 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:44.142111 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-83e0caca-83c1-40b5-a096-41872fb5ef1b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.412796 Jun 30 15:53:44.143101 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 224/436] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:43 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:44.309779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-e1b66539-7cd5-4e57-adc9-cc0dab2e3a82 req-08826d18-3986-4abb-93e6-41345cb5b779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "name": "network-vif-unplugged", "status": "completed", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:44.325076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e1b66539-7cd5-4e57-adc9-cc0dab2e3a82 req-08826d18-3986-4abb-93e6-41345cb5b779 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:44.326415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e1b66539-7cd5-4e57-adc9-cc0dab2e3a82 req-08826d18-3986-4abb-93e6-41345cb5b779 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:44.348140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-e1b66539-7cd5-4e57-adc9-cc0dab2e3a82 req-08826d18-3986-4abb-93e6-41345cb5b779 service nova] Creating event network-vif-unplugged:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:53:44.361370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-e1b66539-7cd5-4e57-adc9-cc0dab2e3a82 req-08826d18-3986-4abb-93e6-41345cb5b779 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056052 Jun 30 15:53:44.362146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 213/437] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:45.126300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:45.127031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:45.136021 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.136557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.137596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.138193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.165633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:45.167090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:45.174047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.174627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.176140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.176751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.381100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:45.384441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:45.389651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:45.391285 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:45.392221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a0803711-8b25-4c35-930d-027af9d88c14 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.234749 Jun 30 15:53:45.392463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b6ed87bd-7996-4e79-a537-7543c93b983c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1726 microversion: 2.20 time: 0.281432 Jun 30 15:53:45.392784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 214/438] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:45 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:45.393290 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 225/439] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:45 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1726 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:45.397793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-431ae7ce-5d8a-42f4-a9fd-cdeeaec268f5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'create', calling method: .version_select at 0x7fbbdb204280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-138450744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt5DTvlkUoR/7p3zvPZce1WO56LriBYyCeMXscwwNXavXsc2hoqCeLkdPdxLStHWz5wYIZV5ad6WUuXFLT0LGeBfCy3DW6rWZmq89frZfPC8AIh8o/GNUQdlNjVtgV45g=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:45.410481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8c8e6ad-3790-4564-b3b1-b509e50ae8da"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:45.411625 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:45.412288 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-431ae7ce-5d8a-42f4-a9fd-cdeeaec268f5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Getting quotas for project e1f6fecd9b364f3bbc6281bf3a2e8ade. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:45.416329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-431ae7ce-5d8a-42f4-a9fd-cdeeaec268f5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Getting quotas for user b8203a321cce4c558a69ff6ca75a4d27 and project e1f6fecd9b364f3bbc6281bf3a2e8ade. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:45.417859 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.418312 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.419070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.419496 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.444122 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-431ae7ce-5d8a-42f4-a9fd-cdeeaec268f5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049556 Jun 30 15:53:45.444999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 215/440] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:53:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:45.494410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1575199725", "imageRef": "7a3741ce-ab0b-4729-ae01-b628e6f7b363", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-138450744", "networks": [{"uuid": "b3042a11-0d1c-4536-ab2e-1870c313f775"}]}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:45.547826 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] validate_networks() for [('b3042a11-0d1c-4536-ab2e-1870c313f775', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:53:45.720836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-55e180f4-7cdc-4811-89f0-3d335fdf0856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314195 Jun 30 15:53:45.721475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 226/441] 10.222.0.50 () {62 vars in 1363 bytes} [Thu Jun 30 15:53:45 2022] POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 15:53:45.865206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:45.865771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:45.872797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.873240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.874011 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.874440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.944534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:53:45.945210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:53:45.945685 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:53:45.946117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:53:45.946504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:53:45.958508 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.959081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.960343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.960964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.978622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Getting quotas for project e1f6fecd9b364f3bbc6281bf3a2e8ade. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:53:45.980129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0144f0ef-3b0d-4840-96ba-cbe992b4b322 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/action" status: 202 len: 0 microversion: 2.20 time: 0.119113 Jun 30 15:53:45.981089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 227/442] 10.222.0.50 () {62 vars in 1318 bytes} [Thu Jun 30 15:53:45 2022] POST /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 30 15:53:45.983229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Getting quotas for user b8203a321cce4c558a69ff6ca75a4d27 and project e1f6fecd9b364f3bbc6281bf3a2e8ade. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:53:45.989162 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:45.989770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:45.995691 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:53:45.995926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.996361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.997124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:45.997553 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:45.997990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a3741ce-ab0b-4729-ae01-b628e6f7b363',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:53:46.069723 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-88088c21-5802-4935-ad3a-8a0d56a330ce tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578598 Jun 30 15:53:46.070729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 216/443] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 15:53:46.080126 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-37d10db4-0e5f-44e6-bfc5-7c7ac4068694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:46.080739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-37d10db4-0e5f-44e6-bfc5-7c7ac4068694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:46.173098 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-37d10db4-0e5f-44e6-bfc5-7c7ac4068694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:46.183481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-37d10db4-0e5f-44e6-bfc5-7c7ac4068694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1258 microversion: 2.1 time: 0.106798 Jun 30 15:53:46.193316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 217/444] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:46 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1258 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:46.209295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:46.223900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:46.226963 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:46.228368 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f9483206-dc5e-4a22-8332-12fe1a54d5f4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1752 microversion: 2.20 time: 0.242899 Jun 30 15:53:46.229085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 228/445] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:45 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:53:46.397756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-2fbdfb7d-59a4-4d9f-aab9-aaf8a1268b8e req-e19d2ac1-1753-445a-9e2c-edd08e278d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b17294c-3c9b-481a-b90b-36b12e5d2c5a", "name": "network-vif-plugged", "status": "completed", "tag": "f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:46.410521 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:46.411197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:46.421233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:46.423326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:46.424326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:46.426115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-2fbdfb7d-59a4-4d9f-aab9-aaf8a1268b8e req-e19d2ac1-1753-445a-9e2c-edd08e278d83 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:46.426733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:46.428657 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-2fbdfb7d-59a4-4d9f-aab9-aaf8a1268b8e req-e19d2ac1-1753-445a-9e2c-edd08e278d83 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:46.457068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-2fbdfb7d-59a4-4d9f-aab9-aaf8a1268b8e req-e19d2ac1-1753-445a-9e2c-edd08e278d83 service nova] Creating event network-vif-plugged:f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa for instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a on hv-cinder-79760 Jun 30 15:53:46.466580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-2fbdfb7d-59a4-4d9f-aab9-aaf8a1268b8e req-e19d2ac1-1753-445a-9e2c-edd08e278d83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073101 Jun 30 15:53:46.471837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 218/446] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:46.644662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:46.653570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-df368d3b-833b-4e4b-a66c-2e476a901eb0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.248106 Jun 30 15:53:46.664046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 229/447] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:46 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:47.202055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:47.202682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:47.210083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.210528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.211304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.211762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.247690 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:47.248409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:47.255367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.255904 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.256766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.257295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.261666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:47.279599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:47.288386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-53c4defe-ad2c-4cd9-b49e-500b4ac7bae8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1310 microversion: 2.1 time: 0.090638 Jun 30 15:53:47.289155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 219/448] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:47 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:47.400271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:47.409211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:47.410717 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:47.411880 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f1e73e1e-b696-4627-85ed-b43cee113733 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1752 microversion: 2.20 time: 0.168127 Jun 30 15:53:47.412448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 230/449] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:47 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:47.672813 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:47.673569 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:47.680999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.681497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.682353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:47.682820 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:47.834781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:47.843021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0733e211-80fb-482a-b5b3-6ba3b314fd56 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.174815 Jun 30 15:53:47.843665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 220/450] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:47 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:48.306678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:48.308243 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:48.314635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.315085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:48.315843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.316298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:48.392494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:48.401782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e2320c78-42c3-4111-92f7-93853a2f1e3e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1316 microversion: 2.1 time: 0.099534 Jun 30 15:53:48.402647 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 231/451] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:48 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1316 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:48.430354 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:48.430966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:48.437619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.438151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:48.439057 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.439559 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:48.638272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:48.646947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:48.648499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:48.649662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3335d64d-0a6c-471e-b7e2-00c60794892d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1754 microversion: 2.20 time: 0.223363 Jun 30 15:53:48.650242 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 221/452] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:48 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:48.861604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:48.862232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:48.868861 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.869391 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:48.870249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:48.870938 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:49.032771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:49.040432 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2b44aa0b-f225-4e1b-8fc5-2ab1f5508bc4 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1264 microversion: 2.1 time: 0.184117 Jun 30 15:53:49.040995 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 232/453] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:48 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:49.422444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:49.423509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:49.437150 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:49.438583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:49.439852 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:49.441610 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:49.653271 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:49.663442 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-50f4e2dc-1bd9-4559-97f2-082ae0a96052 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.246226 Jun 30 15:53:49.665779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 222/454] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:49 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:49.669264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:49.670515 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:49.677627 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:49.678082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:49.678850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:49.679292 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:49.970622 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:49.979539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:49.981128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:49.982613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1d71552f-0132-4884-9784-e9c07eed39e3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.317919 Jun 30 15:53:49.988384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 233/455] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:49 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:50.060094 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:50.060795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:50.088009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.088615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.089764 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.091819 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.138650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-24e4f01a-cfe2-46c8-96e2-0e45c1689c8b req-1e4c75eb-524d-4951-8f8e-6e7778c8e506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:50.151088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-24e4f01a-cfe2-46c8-96e2-0e45c1689c8b req-1e4c75eb-524d-4951-8f8e-6e7778c8e506 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.152139 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-24e4f01a-cfe2-46c8-96e2-0e45c1689c8b req-1e4c75eb-524d-4951-8f8e-6e7778c8e506 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.180803 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-24e4f01a-cfe2-46c8-96e2-0e45c1689c8b req-1e4c75eb-524d-4951-8f8e-6e7778c8e506 service nova] Creating event network-changed:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:53:50.189943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-24e4f01a-cfe2-46c8-96e2-0e45c1689c8b req-1e4c75eb-524d-4951-8f8e-6e7778c8e506 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058615 Jun 30 15:53:50.191221 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 234/456] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:50.278342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:50.291916 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-87d405e8-0454-4c57-93c0-6dbcb66ca547 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1450 microversion: 2.1 time: 0.237535 Jun 30 15:53:50.306394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 223/457] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:50 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1450 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:50.328656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:50.329405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:50.336075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.336448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.337209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.337633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.475143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:50.483757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d60b30b3-1e46-4f2b-872a-1e9f563fe5ab tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1450 microversion: 2.1 time: 0.163236 Jun 30 15:53:50.484847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 235/458] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:50 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:53:50.680984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:50.681546 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:50.688969 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.689597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.690291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:50.690920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:50.836313 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:50.846405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-989bb62f-8243-415f-af55-d31d30f6fc5f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.169111 Jun 30 15:53:50.846910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 224/459] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:50 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:51.003032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:51.004302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:51.011150 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:51.011596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:51.012399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:51.012831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:51.215352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:51.224703 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:51.226525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:51.227760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a5598f0c-be32-42b0-8559-20f9397de278 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.228853 Jun 30 15:53:51.239106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 236/460] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:50 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:51.863736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:51.865239 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:51.872250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:51.872991 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:51.874040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:51.874866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:52.036592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:52.044711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-51a1713c-e5c9-4d0b-b0da-a2f681bbe7c0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.185195 Jun 30 15:53:52.045274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 225/461] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:51 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:52.247252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:52.248098 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:52.255503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:52.255934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:52.256732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:52.257160 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:52.405588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:52.414690 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:52.416614 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:52.417926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-49541ecb-cbfb-42bb-b690-c94142fe6d70 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.174862 Jun 30 15:53:52.418555 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 237/462] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:52 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:52.759899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-b2f287cf-9dd0-48d8-8392-cf1ef845711b req-78c8bb87-12a0-44e6-a0c9-09f41c5c6c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b17294c-3c9b-481a-b90b-36b12e5d2c5a", "tag": "f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:53:52.768381 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-b2f287cf-9dd0-48d8-8392-cf1ef845711b req-78c8bb87-12a0-44e6-a0c9-09f41c5c6c69 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:52.768975 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-b2f287cf-9dd0-48d8-8392-cf1ef845711b req-78c8bb87-12a0-44e6-a0c9-09f41c5c6c69 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:52.780935 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-b2f287cf-9dd0-48d8-8392-cf1ef845711b req-78c8bb87-12a0-44e6-a0c9-09f41c5c6c69 service nova] Creating event network-changed:f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa for instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a on hv-cinder-79760 Jun 30 15:53:52.785946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-b2f287cf-9dd0-48d8-8392-cf1ef845711b req-78c8bb87-12a0-44e6-a0c9-09f41c5c6c69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030904 Jun 30 15:53:52.788203 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 226/463] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:53:53.061149 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:53.061757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:53.075003 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:53.075441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:53.076243 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:53.076678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:53.222505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:53.235241 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8abc548f-7a5c-4a4f-9a99-e9f6d0f79fda tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.174253 Jun 30 15:53:53.236216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 238/464] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:53 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:53.438509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:53.439212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:53.445911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:53.446357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:53.447128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:53.447631 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:53.604584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:53.614210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:53.616003 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:53.617326 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-28a79ec5-6d79-4c9e-8c54-24fc536a3111 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.184442 Jun 30 15:53:53.618337 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 227/465] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:53 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:54.252311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:54.253516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:54.260790 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:54.261242 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:54.262043 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:54.262663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:54.409972 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:54.418035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-95c3ebed-9fc0-4e31-a9bb-1570d3840cc7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.169910 Jun 30 15:53:54.418612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 239/466] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:54 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:54.634898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:54.635637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:54.642346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:54.642786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:54.643542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:54.643970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:54.648238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:54.787461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:54.796754 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:54.798253 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:54.799435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5fc907b2-39d2-434d-b823-6aa324b2c8c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.168617 Jun 30 15:53:54.799980 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 228/467] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:54 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:55.436917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:55.437519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:55.444942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:55.445394 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:55.446161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:55.446592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:55.606319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:55.614439 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7eb3e353-0e0c-4953-b7c3-338cba088f96 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.181463 Jun 30 15:53:55.615024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 240/468] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:55 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:55.818216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:55.818834 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:55.825439 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:55.825886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:55.826658 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:55.827093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:55.970803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:55.973527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:55.990915 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:55.993150 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:55.994955 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-08b44f56-49fb-4418-a0ec-2b03e76fa530 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.180708 Jun 30 15:53:55.995843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 229/469] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:55 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:56.631234 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:56.631919 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:56.639160 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:56.639607 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:56.640427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:56.640855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:56.776603 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:56.784414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5726899f-8c4b-40bd-bf4f-390bbc2f4758 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.157072 Jun 30 15:53:56.784992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 241/470] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:56 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:57.014624 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:57.015884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:57.022676 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=12 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:57.028147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:57.028701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:57.029974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:57.030507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:57.170169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:57.179089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:57.180722 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:57.181898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fc5bd183-a744-4ca8-a69d-a235e3dfb928 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.171357 Jun 30 15:53:57.182495 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 230/471] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:57 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:57.801673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:57.802291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:57.809347 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:57.809796 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:57.810640 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:57.811035 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:57.952821 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:57.960457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0d44a6e0-7992-4877-8e8f-87cc85d3be51 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.162951 Jun 30 15:53:57.961023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 242/472] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:57 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:58.201026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:58.201989 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:58.208621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:58.209059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:58.209851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:58.210267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:58.375953 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:58.385224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:58.397980 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:58.399371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f764b16e-8667-475c-91b6-777234cefc04 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.202333 Jun 30 15:53:58.400450 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 231/473] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:58 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:53:58.981532 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:58.982138 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:58.986591 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=68 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:53:58.991429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:58.991877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:58.992914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:58.993353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:59.155039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:59.163272 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c073fc73-cc82-4599-998f-1de6c3c927a2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.188828 Jun 30 15:53:59.163857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 243/474] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:53:58 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:53:59.419227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:53:59.420206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:53:59.427822 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:59.428301 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:59.429064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:53:59.429490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:53:59.582305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:59.591383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:59.592993 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:53:59.594286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f66b04a7-a261-4cde-826b-5e0fccbdd970 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.179277 Jun 30 15:53:59.594832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 232/475] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:53:59 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:00.180552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:00.181192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:00.188269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.188719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.189492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.189927 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.321263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:00.329587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1f1b8f08-b470-4cab-88d2-fcb03e1db3ef tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.153388 Jun 30 15:54:00.330158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 244/476] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:00 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:00.617290 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:00.618213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:00.627136 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.627702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.628924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.628924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.681491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf4b14b-c130-4c9f-994f-8bb49a0265ab", "device": "/dev/sdb"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:00.683162 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:00.689593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.690385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.691149 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:00.691571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:00.761974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:00.770611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:00.772151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:00.773345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6c3c94b2-5f64-4a38-9498-33bd224f55b3 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.162167 Jun 30 15:54:00.773909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 233/477] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:00 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:00.977959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8ee9a860-c776-4a99-971a-4bedc628be44 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "POST /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300178 Jun 30 15:54:00.978538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 245/478] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:54:00 2022] POST /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:54:01.346788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:01.347404 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:01.354254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:01.354700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:01.355504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:01.355929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:01.792826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:01.793521 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:01.800323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:01.800802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:01.801583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:01.802016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:01.817273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:01.924210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:01.932114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c95b0254-4301-49a4-97ec-9598f12efc2f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.589366 Jun 30 15:54:01.932649 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 234/479] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:01 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:02.199016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:02.209016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:02.210536 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:02.211715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8a1a0c2e-5f06-4f02-bf09-4915e56d8e7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.423975 Jun 30 15:54:02.212311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 246/480] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:01 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:02.952812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:02.953387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:02.960430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:02.961295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:02.962061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:02.962496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:03.105161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:03.113056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9516ec2c-0ec4-4c50-ba64-084cb5e38dbf tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.166880 Jun 30 15:54:03.113624 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 235/481] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:02 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:03.234060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:03.234716 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:03.241918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:03.242413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:03.243188 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:03.243641 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:03.381809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:03.391153 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:03.393786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:03.394949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-baf8e274-44e2-4088-a64f-4a6d8ee134cb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.167723 Jun 30 15:54:03.395637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 247/482] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:03 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:04.130690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:04.132081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:04.138964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:04.141270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:04.141982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:04.143058 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:04.143828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:04.341986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:04.350016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d97f0c7e-693d-4d2a-b148-c7bee7843d63 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.223534 Jun 30 15:54:04.350844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 236/483] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:04 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:04.413360 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:04.414021 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:04.426245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:04.426998 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:04.427957 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:04.428635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:04.574862 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:04.584971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:04.588960 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:04.590266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d11fc63e-27bf-401a-8714-93c3d197343d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.181261 Jun 30 15:54:04.590832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 248/484] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:04 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:05.367541 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:05.368160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:05.375221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:05.375655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:05.376446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:05.376874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:05.516082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:05.525240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c3b5672e-355e-4c71-a5f0-e88f39043acd tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.161627 Jun 30 15:54:05.531305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 237/485] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:05 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:05.610547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:05.611165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:05.618102 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:05.622581 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:05.623407 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:05.623964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:05.762449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:05.771206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:05.772666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:05.773828 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9ade2dd3-ba25-45cd-8100-b1705a404fcf tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.168024 Jun 30 15:54:05.774391 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 249/486] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:05 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:54:06.330007 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-80a909f4-1e5b-4f8b-92be-32101e7cd6af req-38f45613-1e24-4616-9894-ef34a1c1a5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "name": "network-vif-plugged", "status": "completed", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:06.338773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-80a909f4-1e5b-4f8b-92be-32101e7cd6af req-38f45613-1e24-4616-9894-ef34a1c1a5d3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:06.339291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-80a909f4-1e5b-4f8b-92be-32101e7cd6af req-38f45613-1e24-4616-9894-ef34a1c1a5d3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:06.353014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-80a909f4-1e5b-4f8b-92be-32101e7cd6af req-38f45613-1e24-4616-9894-ef34a1c1a5d3 service nova] Creating event network-vif-plugged:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:54:06.358437 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-80a909f4-1e5b-4f8b-92be-32101e7cd6af req-38f45613-1e24-4616-9894-ef34a1c1a5d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Jun 30 15:54:06.359902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 238/487] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:54:06.542269 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:06.543255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:06.550093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:06.550542 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:06.551316 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:06.551783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:06.685202 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:06.693850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1a884feb-5f91-4e22-96ff-4c8537d530ba tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.155406 Jun 30 15:54:06.694774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 250/488] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:06 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:06.802838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:06.803578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:06.810707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:06.811383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:06.813153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:06.813783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:06.964550 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:06.973581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:06.975378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:06.976612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c6e8fa33-893d-4efd-925a-57e879e494a2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.178692 Jun 30 15:54:06.977171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 239/489] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:06 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:07.711298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:07.711974 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:07.718857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:07.719313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:07.720107 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:07.720539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:07.867265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:07.875329 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-43fe8fc3-b99f-4640-a3ff-75f6dc718b60 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.168136 Jun 30 15:54:07.875900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 251/490] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:07 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:07.994849 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:07.995516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:08.003390 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:08.003884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:08.004692 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:08.005127 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:08.167524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:08.181951 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:08.184018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:08.185292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-547ca257-f048-4f41-a4ae-3f87a8fc3cc2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.194418 Jun 30 15:54:08.186040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 240/491] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:07 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:08.892730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:08.893341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:08.899934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:08.900416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:08.901183 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:08.901611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:09.039279 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:09.048360 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bec01ca4-3b43-4d70-9105-8170c8f2b72f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.159603 Jun 30 15:54:09.049414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 252/492] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:08 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:09.205940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:09.206559 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:09.215075 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:09.215315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:09.216109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:09.216540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:09.359683 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:09.368797 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:09.370269 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:09.371513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-311178ef-303c-41e4-ba76-4652d673a9cc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.169652 Jun 30 15:54:09.372395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 241/493] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:09 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:10.066047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:10.066684 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:10.074014 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:10.081903 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:10.082832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:10.083305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:10.236164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:10.244615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cba8501f-a7b3-46bc-84b8-e2615fcf06f7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.182404 Jun 30 15:54:10.245305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 253/494] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:10 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:10.391195 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:10.391925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:10.398894 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:10.399327 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:10.400323 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:10.401005 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:10.539113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:10.548237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:10.549747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:10.550920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ff904679-0715-4ab1-b5c4-125cf2daeae6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.163880 Jun 30 15:54:10.551501 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 242/495] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:10 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:11.262257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:11.262873 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:11.270232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:11.271150 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:11.272153 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:11.272550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:11.416758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:11.425046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-96830ce4-7fa4-4050-8d44-d7a32851ca31 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.166678 Jun 30 15:54:11.425991 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 254/496] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:11 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:11.570653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:11.571558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:11.579009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:11.579485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:11.580295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:11.580731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:11.729833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:11.738930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:11.740467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:11.741643 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b781a8ff-e81f-4cdb-a4e6-2db475db55da tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.175078 Jun 30 15:54:11.742419 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 243/497] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:11 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:12.443505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:12.444661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:12.452209 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:12.452768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:12.453666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:12.454097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:12.596672 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:12.604594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cd983b8a-3833-49e7-97fd-1595cd571275 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.165160 Jun 30 15:54:12.605406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 255/498] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:12 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:12.759789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:12.760446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:12.767326 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:12.767871 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:12.768662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:12.769085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:12.900044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:12.909037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:12.910538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:12.912034 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ebc2d422-e936-4f74-a9d7-90e0af1faf6e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.156108 Jun 30 15:54:12.912584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 244/499] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:12 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:13.621310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:13.621913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:13.629051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:13.629529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:13.630338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:13.630732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:13.765762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:13.773151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3cc442f4-18d6-48bf-8406-1e0032d498a8 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.155891 Jun 30 15:54:13.773815 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 256/500] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:13 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:13.930857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:13.931461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:13.938196 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:13.938885 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:13.939655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:13.940113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:13.961232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:14.079293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:14.088212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:14.089731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:14.090891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2c28c959-4dff-422d-a5de-67131abe9b4b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.164026 Jun 30 15:54:14.091439 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 245/501] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:13 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:14.794328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:14.795392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:14.806690 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:14.807437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:14.808732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:14.809440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:14.945268 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:14.955636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5e77284b-2e45-46ae-b794-51e50f0808c5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.167828 Jun 30 15:54:14.956237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 257/502] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:14 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:15.112099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:15.112687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:15.119632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:15.120082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:15.120850 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:15.121284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:15.259782 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:15.270887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:15.272353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:15.273521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5ca450d7-9a5f-4e01-b0c7-1c2b3ce3c8ec tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.167086 Jun 30 15:54:15.274073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 246/503] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:15 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:15.973475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:15.974107 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:15.980834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:15.981275 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:15.982019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:15.982444 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:16.117781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:16.125675 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a88345c0-e6ae-494b-9bba-686f4f8f0a03 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.156166 Jun 30 15:54:16.126237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 258/504] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:15 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:16.292249 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:16.292889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:16.299828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:16.300308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:16.301069 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:16.301503 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:16.501341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:16.509977 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:16.511480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:16.512669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e0282154-93c2-49f7-b1f2-9cd9eb0f2b19 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.224636 Jun 30 15:54:16.513238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 247/505] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:16 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:17.142988 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:17.143829 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:17.150303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:17.150753 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:17.151512 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:17.151951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:17.289267 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:17.296934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-12129082-0c8e-4f83-bb4a-6ac451313349 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.158042 Jun 30 15:54:17.297490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 259/506] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:17 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:17.535308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:17.536184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:17.547268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:17.548052 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:17.549341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:17.550069 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:17.684886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:17.694164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:17.695678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:17.696873 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-de6efab6-eb7c-42ec-9a8f-122dcf6fee7b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.168489 Jun 30 15:54:17.697429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 248/507] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:17 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:18.314299 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:18.314882 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:18.321865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:18.322310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:18.323056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:18.323480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:18.461482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:18.469042 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-277ff34c-c61e-46d0-9833-f0d938dee69b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.158790 Jun 30 15:54:18.469583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 260/508] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:18 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:18.719462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:18.720468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:18.731732 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:18.732529 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:18.734156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:18.734874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:18.892304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:18.901658 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:18.903144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:18.904326 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f49b111f-2419-4740-a391-5a22ffc8e956 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.192010 Jun 30 15:54:18.904914 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 249/509] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:18 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:19.449775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:19.450375 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:19.458689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.459145 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:19.459907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.460371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:19.486997 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:19.487620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:19.494024 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.494461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:19.495216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.495638 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:19.586681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lazy-loading 'services' on Instance uuid b85185f0-6858-4750-a044-9c3dc44d0240 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:54:19.627389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:19.635045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-109860a3-fc7e-4dc0-be7d-69af771710a5 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.152575 Jun 30 15:54:19.635638 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 250/510] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:19 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:19.702794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6bde504f-577d-4853-9064-599532fef25f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments/f636ef23-138b-4b1f-b424-fc1f2b4e0d2d" status: 202 len: 0 microversion: 2.1 time: 0.256859 Jun 30 15:54:19.703368 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 261/511] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:54:19 2022] DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments/f636ef23-138b-4b1f-b424-fc1f2b4e0d2d => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:54:19.932448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:19.933397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:19.942886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.943331 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:19.944141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:19.944570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:20.077700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:20.086827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:20.088367 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:20.089528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e2d5b57e-ffa1-4c58-988a-6728a308a896 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.163793 Jun 30 15:54:20.089998 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6f01809-0e1e-4715-bda1-1e87c81b4a13"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:20.090926 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 251/512] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:19 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:20.091231 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:20.098332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:20.098776 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:20.099503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:20.100182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:20.103835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:20.655946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:20.656811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:20.664966 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:20.665403 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:20.666142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:20.666567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:20.797623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:20.805395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7914f253-292d-44f1-a9df-85e5b4f6a30d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1358 microversion: 2.1 time: 0.155529 Jun 30 15:54:20.806186 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 252/513] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:20 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:20.990966 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d6c6110d-342f-4467-828d-3356001d88f5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905223 Jun 30 15:54:20.991573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 262/514] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:54:20 2022] POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:21.111171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:21.112179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:21.120189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:21.120637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:21.121397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:21.121832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:21.251412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:21.260362 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:21.261829 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:21.262983 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9709233a-7de6-4a13-9b4d-636d57102104 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.158821 Jun 30 15:54:21.263559 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 253/515] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:21 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:21.825197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:21.826144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:21.834824 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:21.835503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:21.836507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:21.836981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:21.972226 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:21.980420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4ffdc4da-5970-4970-9b71-20aa41d496d4 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1547 microversion: 2.1 time: 0.160704 Jun 30 15:54:21.981018 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 263/516] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:21 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:22.000084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:22.000721 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:22.007163 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.007610 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.008403 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.008830 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.144340 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.152812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-52cbea21-a52f-4581-8890-a3b90cff2a9f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1547 microversion: 2.1 time: 0.156658 Jun 30 15:54:22.153430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 254/517] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:21 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:22.168905 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:22.174325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.175673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Searching by: {'deleted': False, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade'} {{(pid=129449) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 15:54:22.185307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.185737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.186507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.186928 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.279684 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.multi_cell_list [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 15:54:22.282590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:22.283428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:22.290868 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.291315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.292177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.292607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.373196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-614cc37f-7e05-4028-aa02-0370ccd22679 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208216 Jun 30 15:54:22.373793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 264/518] 10.222.0.50 () {58 vars in 1124 bytes} [Thu Jun 30 15:54:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:22.384155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:22.384754 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:22.390793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.391233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.392223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:22.392655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:22.427207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.435954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.437504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.438678 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cc863436-e211-40df-985f-0e076df3efe0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.160998 Jun 30 15:54:22.439269 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 255/519] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:22 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:22.525434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:22.533492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e57ec950-81d5-417c-86b6-1b796c18a030 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1547 microversion: 2.1 time: 0.153245 Jun 30 15:54:22.534033 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 265/520] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:22 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:23.457707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:23.458244 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:23.465292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:23.465732 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:23.466457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:23.467065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:23.600883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:23.609717 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:23.611212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:23.612371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-86ace030-7e53-4e33-a431-0f0c6d501972 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.158745 Jun 30 15:54:23.612932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 256/521] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:23 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:24.634388 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:24.635258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:24.643483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:24.644025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:24.644962 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:24.645470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:24.779544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:24.789301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:24.790796 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:24.791962 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3cd2d88f-5a83-49a6-a494-396dadc3bd27 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.163084 Jun 30 15:54:24.792564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 266/522] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:24 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:25.811752 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:25.812412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:25.821902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:25.822355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:25.823114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:25.823555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:25.964936 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:25.979108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:25.981662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:25.983942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-31df283d-2fa3-44f6-851a-31fd8ed698ba tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.176805 Jun 30 15:54:25.984877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 257/523] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:25 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:26.218702 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7cde753-5d12-41e4-abab-2a17392b7ca3"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:26.219778 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:26.226975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:26.227430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:26.228233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:26.228671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:26.289718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9ec574f6-6894-4249-bbb1-6c4a2fe8a2ce tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:26.295856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9ec574f6-6894-4249-bbb1-6c4a2fe8a2ce tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:26.296332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9ec574f6-6894-4249-bbb1-6c4a2fe8a2ce tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:26.320203 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9ec574f6-6894-4249-bbb1-6c4a2fe8a2ce tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Going to try to stop instance {{(pid=129450) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 15:54:26.365789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9ec574f6-6894-4249-bbb1-6c4a2fe8a2ce tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action" status: 202 len: 0 microversion: 2.1 time: 0.081162 Jun 30 15:54:26.366349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 258/524] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:54:26 2022] POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:54:26.374556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:26.375207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:26.381400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:26.381840 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:26.382590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:26.383019 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:26.521908 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:26.529777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-748c16f7-c98a-49f8-8c3a-f9639335854c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.159179 Jun 30 15:54:26.530328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 259/525] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:26 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:27.009250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:27.009904 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:27.016847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:27.017365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:27.018308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:27.018801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:27.154630 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:27.163168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:27.165109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:27.166268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-05ccd9da-a200-4079-a361-865057bb8cc7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.161926 Jun 30 15:54:27.166794 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 260/526] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:27 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:54:27.550946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:27.552166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:27.562061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:27.562803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:27.565202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:27.566541 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:27.571688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:27.702972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:27.710787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5df8c2f9-b7b4-42f2-a39a-d2fb15190859 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.166455 Jun 30 15:54:27.711337 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 261/527] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:27 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:28.184795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:28.185367 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:28.192172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:28.192654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:28.193546 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:28.193982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:28.364728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:28.378601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:28.381299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:28.382488 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e0015d41-8b09-4714-9552-967b7a946c47 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.201729 Jun 30 15:54:28.383038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 262/528] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:28 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:28.731776 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:28.733217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:28.742002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:28.742454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:28.743219 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:28.743651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:28.884248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:28.892388 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a2030670-54bb-44cb-b6a2-3a4981ea6f13 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.166541 Jun 30 15:54:28.892955 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 263/529] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:28 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:29.291860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-efe9f9d1-b20f-41f9-8035-df95fadcc917 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.077063 Jun 30 15:54:29.292535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 267/530] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:54:26 2022] POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments => generated 194 bytes in 3079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:29.406287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:29.406900 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:29.413519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:29.413964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:29.414725 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:29.415155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:29.557705 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:29.566556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:29.568372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:29.569564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-04603da7-b2d2-43cc-919c-c9d928efbf42 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.167311 Jun 30 15:54:29.570505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 264/531] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:29 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:29.913451 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:29.914070 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:29.916023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=50 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:29.921918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:29.922386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:29.923118 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:29.923543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:30.057812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:30.065900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-28c9a85b-f5ca-4526-b756-3667c771af72 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.159269 Jun 30 15:54:30.066479 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 268/532] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:29 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:30.587551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:30.588201 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:30.595304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:30.595410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:30.596227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:30.596661 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:30.731044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:30.744288 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:30.746612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:30.748413 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f77bf90d-a499-432f-a49a-e3d3145b316c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.164556 Jun 30 15:54:30.749254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 265/533] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:30 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:31.088457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:31.089467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:31.097322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:31.097987 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:31.098760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:31.099221 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:31.229843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-968fab2f-55db-4f1b-8b0f-51d3cbb73bc9 req-21cc9843-657e-4731-8184-2aa2a493a4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "name": "network-vif-plugged", "status": "completed", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:31.241438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:31.248276 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-968fab2f-55db-4f1b-8b0f-51d3cbb73bc9 req-21cc9843-657e-4731-8184-2aa2a493a4be service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:31.248731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-968fab2f-55db-4f1b-8b0f-51d3cbb73bc9 req-21cc9843-657e-4731-8184-2aa2a493a4be service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:31.256884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4b497299-f557-48b3-8c1f-9023e8797912 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.175851 Jun 30 15:54:31.257460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 269/534] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:31 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:31.264765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-968fab2f-55db-4f1b-8b0f-51d3cbb73bc9 req-21cc9843-657e-4731-8184-2aa2a493a4be service nova] Creating event network-vif-plugged:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:54:31.270190 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-968fab2f-55db-4f1b-8b0f-51d3cbb73bc9 req-21cc9843-657e-4731-8184-2aa2a493a4be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044795 Jun 30 15:54:31.270782 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 266/535] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:54:31.773971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:31.774610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:31.781323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:31.781774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:31.782538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:31.782971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:31.974220 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:31.983600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:31.985149 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:31.986318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-61f7a4f8-1f6f-4f88-8d08-740ad4668824 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.216757 Jun 30 15:54:31.986884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 270/536] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:31 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:32.275208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:32.275899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:32.284062 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:32.284731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:32.285851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:32.285972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:32.425407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:32.433702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-059c35b2-053b-4ad8-b8d6-80de03058e77 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.162574 Jun 30 15:54:32.434309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 267/537] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:32 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:33.008783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:33.009513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:33.011817 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:33.019293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.019856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.020902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.021448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.346224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:33.346784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:33.353231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.353684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.354452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.354891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.416105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:33.425184 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:33.426673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:33.427833 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-95f1cb38-2e00-4d5a-8649-a175db15d963 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.425523 Jun 30 15:54:33.428426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 271/538] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:33 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:33.450600 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:33.451244 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:33.457237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.457647 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.458421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:33.458845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:33.506403 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lazy-loading 'services' on Instance uuid 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:54:33.592156 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:33.599759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7440d318-5f6a-4a12-9015-edcb55852ae2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.152896 Jun 30 15:54:33.600332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 272/539] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:33 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:33.628740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7eed3400-ccc8-441e-a219-368598115f21 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390/os-volume_attachments/faf4b14b-c130-4c9f-994f-8bb49a0265ab" status: 202 len: 0 microversion: 2.1 time: 0.286386 Jun 30 15:54:33.629346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 268/540] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:54:33 2022] DELETE /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390/os-volume_attachments/faf4b14b-c130-4c9f-994f-8bb49a0265ab => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:54:34.446272 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:34.446920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:34.453978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:34.454363 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:34.455129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:34.455554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:34.601173 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:34.609944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:34.611676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:34.612853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c6c7cf33-be4d-4888-b4ac-00d08ad2a015 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1810 microversion: 2.20 time: 0.170685 Jun 30 15:54:34.613849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 273/541] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:34 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:34.619878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:34.620659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:34.623115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=66 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:34.628817 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:34.629295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:34.630057 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:34.630492 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:34.769222 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:34.776980 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-78d98627-18bf-4790-9f0d-f3a691f178e6 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.162240 Jun 30 15:54:34.777593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 269/542] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:34 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:35.632120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:35.632663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:35.639775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:35.640261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:35.641021 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:35.641454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:35.782568 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:35.798185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:35.798185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:35.798185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-70e24231-d4d6-47f8-8b1c-0e8e4672b33d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1797 microversion: 2.20 time: 0.166495 Jun 30 15:54:35.798512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:35.798951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 274/543] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:54:35 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1797 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:54:35.799044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:35.802418 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:35.802865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:35.803623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:35.804098 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:35.938762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:35.948184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-95f43419-7e80-4743-b7b2-7a6a1d01acc3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.157140 Jun 30 15:54:35.948759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 270/544] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:35 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:36.965774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:36.966411 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:36.973432 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:36.973889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:36.974686 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:36.975114 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:37.023158 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:37.024423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:37.031289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:37.031833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:37.032703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:37.033751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:37.058983 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'flavor' on Instance uuid 2a57f154-45c7-46ac-9822-bedfd64be7a2 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:54:37.117300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:37.121978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:37.126881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-baec527d-be90-453f-97d1-514baf22d26d tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.164988 Jun 30 15:54:37.136781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 275/545] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:36 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:37.191362 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-75e87fac-4ca8-49e3-bf71-923d1dd3febf tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/action" status: 200 len: 32 microversion: 2.1 time: 0.171692 Jun 30 15:54:37.191888 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 271/546] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:54:37 2022] POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:54:37.201707 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:37.202327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:37.209222 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:37.209821 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:37.210655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:37.211287 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:37.341107 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:37.349536 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b7241e6b-706e-45f4-8a16-f2ac6c778287 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.152288 Jun 30 15:54:37.350093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 276/547] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:37 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:38.145272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:38.145732 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:38.152022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:38.152456 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:38.153212 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:38.153639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:38.291296 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:38.302519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1ed38e13-caf9-4395-beae-e00b506bca17 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.162382 Jun 30 15:54:38.303164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 272/548] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:38 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:38.369811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:38.370333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:38.377307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:38.377752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:38.378508 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:38.378937 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:38.518227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:38.527467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-20cecaf9-c8ea-411a-ae4a-981432dc7f40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.163815 Jun 30 15:54:38.528061 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 277/549] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:38 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:39.320008 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:39.320590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:39.328089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:39.328533 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:39.329283 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:39.329711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:39.470013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:39.481478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e5916081-6853-4f0c-9413-5b89181988ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.165393 Jun 30 15:54:39.482040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 273/550] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:39 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:39.547488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:39.548201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:39.557313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:39.557897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:39.558888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:39.559447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:39.698941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:39.709972 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3b912988-eb46-43c3-acde-8fc461d85313 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.167670 Jun 30 15:54:39.710768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 278/551] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:39 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:40.508768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:40.509745 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:40.517037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:40.517507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:40.518294 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:40.518747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:40.656526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:40.664373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-df1b98e0-4739-4151-9081-11cdfb83398c tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.162244 Jun 30 15:54:40.664936 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 274/552] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:40 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:40.730436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:40.731441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:40.742848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:40.743646 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:40.744774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:40.745211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:40.883201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:40.891594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8769e2a4-b3a3-4f14-900c-6de0c29ca925 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.167542 Jun 30 15:54:40.892175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 279/553] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:40 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:41.686605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:41.687440 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:41.698264 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:41.698714 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:41.699479 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:41.699903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:41.839018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:41.844024 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:41.849961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7aaea2bf-144f-4b1d-9981-64c6049a1d20 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.169985 Jun 30 15:54:41.850555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 275/554] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:41 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:41.912741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:41.913419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:41.920464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:41.920912 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:41.921674 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:41.922131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:42.068786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:42.080246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-397aff5f-9b19-4b6a-81ad-13a2390434f6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.171363 Jun 30 15:54:42.080836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 280/555] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:41 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:42.868675 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:42.869369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:42.876743 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:42.877187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:42.877950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:42.878378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:43.015669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:43.023656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-94853afd-e2f7-4821-8e46-9648f78320f2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.158950 Jun 30 15:54:43.024231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 276/556] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:42 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:43.097662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:43.098387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:43.105462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:43.105907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:43.106678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:43.107466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:43.241835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:43.250376 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4f5e7eb4-5ef5-40c0-a126-dc87452283fa tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.156737 Jun 30 15:54:43.250937 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 281/557] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:43 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:43.251281 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:43.252052 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:43.258632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:43.259226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:43.260125 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:43.260555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:43.396763 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:43.405279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3f8240d8-417b-402c-97a6-d8de32fb6382 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1593 microversion: 2.1 time: 0.157979 Jun 30 15:54:43.405823 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 277/558] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:43 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:54:44.042553 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:44.043166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:44.049739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.050157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.050952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.051409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.179129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:44.187020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8bcecbbb-6e21-4cb2-b750-1a8290a331b0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1680 microversion: 2.1 time: 0.149520 Jun 30 15:54:44.187583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 282/559] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:44 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:44.250766 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:44.251481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:44.258093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.258547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.259310 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.259786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.267543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:44.268652 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:44.275359 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.275883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.276941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.277618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.293417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:54:44.388100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-aa929cb5-7e06-4dbd-8a28-0d9106752e4d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 204 len: 0 microversion: 2.1 time: 0.140662 Jun 30 15:54:44.388584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 278/560] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:54:44 2022] DELETE /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:54:44.398236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:44.398944 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:44.405074 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.405518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.406293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:44.406725 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:44.451457 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:44.461296 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8a71bb50-f3b9-40ea-b803-787401ee3f0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.197827 Jun 30 15:54:44.471499 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 283/561] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:44 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:44.567538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:44.575300 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-249d4318-f1b8-4768-b0f8-0b47f4041b5c tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1513 microversion: 2.1 time: 0.182109 Jun 30 15:54:44.575930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 279/562] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:44 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:45.204779 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:45.205365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:45.212811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.213228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.214523 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.214627 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.278073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-06aad55a-9f83-43a7-a89c-9832073114b3 req-a45732e7-fe37-4792-ad50-178f60c172d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:45.292835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-06aad55a-9f83-43a7-a89c-9832073114b3 req-a45732e7-fe37-4792-ad50-178f60c172d4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.294262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-06aad55a-9f83-43a7-a89c-9832073114b3 req-a45732e7-fe37-4792-ad50-178f60c172d4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.305396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-06aad55a-9f83-43a7-a89c-9832073114b3 req-a45732e7-fe37-4792-ad50-178f60c172d4 service nova] Creating event network-changed:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:54:45.310827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-06aad55a-9f83-43a7-a89c-9832073114b3 req-a45732e7-fe37-4792-ad50-178f60c172d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036927 Jun 30 15:54:45.312195 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 280/563] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:45.359388 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:45.367159 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6530c540-0e07-4c6f-b295-1099480fc835 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1657 microversion: 2.1 time: 0.166341 Jun 30 15:54:45.367960 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 284/564] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:45 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:45.385096 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2ebe3d7e-6cad-4f6c-9a29-fab7e04b7c0f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:45.391472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2ebe3d7e-6cad-4f6c-9a29-fab7e04b7c0f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.392268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2ebe3d7e-6cad-4f6c-9a29-fab7e04b7c0f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.415205 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2ebe3d7e-6cad-4f6c-9a29-fab7e04b7c0f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Going to try to start instance {{(pid=129450) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 15:54:45.469097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2ebe3d7e-6cad-4f6c-9a29-fab7e04b7c0f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action" status: 202 len: 0 microversion: 2.1 time: 0.088157 Jun 30 15:54:45.470115 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 281/565] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:54:45 2022] POST /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:54:45.478396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:45.479108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:45.479747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:45.479868 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:45.488905 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.489143 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.489397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.490019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.490176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.490793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.491682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.492239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.748835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:45.750771 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:45.759062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-391d0d7a-2d6c-4367-8802-b692a9309d5f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1666 microversion: 2.1 time: 0.284554 Jun 30 15:54:45.759644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fe765b37-c766-4a6b-b94c-54070f7d3e35 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.284787 Jun 30 15:54:45.760288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 285/566] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:45 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1666 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:45.769623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:45.769623 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:45.779648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 282/567] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:45 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:45.779867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.779867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.780274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:45.781203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:45.932369 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:45.941233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3e2ef9b0-8c91-44ef-bd13-caa0d212c053 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1513 microversion: 2.1 time: 0.179543 Jun 30 15:54:45.942228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 286/568] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:45 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:46.451619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1765038875"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:46.452213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:46.459119 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:46.459788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:46.460787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:46.461466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:46.777633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:46.778198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:46.785390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:46.785847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:46.786645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:46.787084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:46.873411 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.network.security_group_api [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Adding security group ab33bbd3-ad0a-4a38-898b-25e48b0f8540 to port 7f24ad84-6842-4154-bf9d-47151f73404e Jun 30 15:54:47.509551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:47.517929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b211e3db-3f6e-415c-aa0e-53fae73960cf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1666 microversion: 2.1 time: 0.744409 Jun 30 15:54:47.518545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 287/569] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:46 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1666 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:47.528034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:47.528034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:47.529906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:47.530359 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:47.531108 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:47.531526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.046253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:48.055863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-327e8011-28e2-4ef4-a195-b1ef3f3982bb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.536165 Jun 30 15:54:48.056500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 288/570] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:47 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:48.061106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:48.061705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:48.067844 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.068313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.069064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.069480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.436426 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1dd7feef-8669-4a69-a82f-c2c74ec02fb2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action" status: 202 len: 0 microversion: 2.1 time: 1.988377 Jun 30 15:54:48.441198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 283/571] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:54:46 2022] POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action => generated 0 bytes in 1994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:54:48.455665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-fdf33127-699f-4283-a1b9-f968b29684e1 req-fd0cb815-3b7d-4dab-aa1d-d1dbba73a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:48.472881 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-fdf33127-699f-4283-a1b9-f968b29684e1 req-fd0cb815-3b7d-4dab-aa1d-d1dbba73a7f9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.475028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-fdf33127-699f-4283-a1b9-f968b29684e1 req-fd0cb815-3b7d-4dab-aa1d-d1dbba73a7f9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.490537 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-fdf33127-699f-4283-a1b9-f968b29684e1 req-fd0cb815-3b7d-4dab-aa1d-d1dbba73a7f9 service nova] Creating event network-changed:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:54:48.497809 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-fdf33127-699f-4283-a1b9-f968b29684e1 req-fd0cb815-3b7d-4dab-aa1d-d1dbba73a7f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053797 Jun 30 15:54:48.498805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 284/572] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:48.507092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:48.508091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:48.515418 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.520486 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.521435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.524580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.632651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:48.642409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-34db1713-a280-4d74-b365-65c08bd2792e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1513 microversion: 2.1 time: 0.584871 Jun 30 15:54:48.643338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 289/573] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:48 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1513 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:48.648252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:48.649511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:48.656528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.657808 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.658856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:48.659851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:48.887789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:48.895870 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-bd78d516-8535-4edc-8f10-1717c8433a50 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1759 microversion: 2.1 time: 0.395693 Jun 30 15:54:48.896483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 285/574] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:48 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1759 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:48.940752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:48.948245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-288e04e1-c69a-434c-bd84-5bd8d4b60ec3 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1666 microversion: 2.1 time: 0.303662 Jun 30 15:54:48.948797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 290/575] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:48 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1666 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:49.073516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:49.074363 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:49.080926 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.081322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.082077 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.082505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.228682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:49.237537 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ac5588b0-ff14-469f-b66e-d29e54781d56 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.167944 Jun 30 15:54:49.238110 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 286/576] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:49 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:49.663951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:49.664812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:49.675218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.675953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.677385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.678104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.710216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.710653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.711115 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lazy-loading 'fault' on Instance uuid 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:54:49.753216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:49.761384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f7a67a5c-4d5f-4104-a5e0-dcf5973e4754 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 200 len: 1309 microversion: 2.1 time: 0.104016 Jun 30 15:54:49.761953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 291/577] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:49 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:49.965719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:49.966380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:49.973389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.973838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:49.974601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:49.975030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.187077 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:50.195171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-061a4cd6-5600-4392-9c9c-65688975dbfe tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1670 microversion: 2.1 time: 0.233768 Jun 30 15:54:50.195739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 287/578] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:49 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1670 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:50.255105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:50.256185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:50.263506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:50.264189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.265065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:50.265595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.270312 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=100 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:50.395423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:50.403577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-47b0b4bc-c472-4287-928a-6cef5363a5cb tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.152777 Jun 30 15:54:50.404143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 292/579] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:50 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:50.524599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-1b303c7d-23a5-4f3f-9a28-d277e40a5179 req-f3464075-2fa9-4cab-be2b-4c9d46b89e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73bd8d03-ca91-4e95-b39a-f2e7e59f9390", "name": "network-vif-deleted", "tag": "c769317a-ed4e-478a-ad86-0b94d8afe6bf"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:50.534753 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1b303c7d-23a5-4f3f-9a28-d277e40a5179 req-f3464075-2fa9-4cab-be2b-4c9d46b89e91 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:50.535189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1b303c7d-23a5-4f3f-9a28-d277e40a5179 req-f3464075-2fa9-4cab-be2b-4c9d46b89e91 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.546592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-1b303c7d-23a5-4f3f-9a28-d277e40a5179 req-f3464075-2fa9-4cab-be2b-4c9d46b89e91 service nova] Creating event network-vif-deleted:c769317a-ed4e-478a-ad86-0b94d8afe6bf for instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 on hv-cinder-79760 Jun 30 15:54:50.551900 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-1b303c7d-23a5-4f3f-9a28-d277e40a5179 req-f3464075-2fa9-4cab-be2b-4c9d46b89e91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035806 Jun 30 15:54:50.552513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 288/580] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:54:50.782533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:50.783445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: 73bd8d03-ca91-4e95-b39a-f2e7e59f9390] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:50.792909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:50.793352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.794107 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:50.795196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:50.808494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] HTTP exception thrown: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Request method failure captured: Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 HTTP/1.1 Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbpUwQaWbiMy-ue5kJJq0JgDAHWeNR34UHQRRAydC0Iar9o6FOvGPIFYKB7wvaGFXizq927WvDfy44eFFa2L16WTlQSU_Mh-byJ6e_Jf09jSTJOwadwCAzkwfby58An-uPGiIQXdreawac4v1Vdl5fzFlRjVbJVSMpaciwFlNhRnMo Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: cf17d9690bf54b98815f00334a3470bc Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:54:50.810110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf17d9690bf54b98815f00334a3470bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: cf17d9690bf54b98815f00334a3470bc Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesSnapshotTestJSON-169065257-project Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: b9a7593adca849d49a95cec18d31ee14 Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesSnapshotTestJSON-169065257-project Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. Jun 30 15:54:50.811588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '73bd8d03-ca91-4e95-b39a-f2e7e59f9390'} Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:54:50.812709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. Jun 30 15:54:50.814261 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:54:50.815462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Returning 404 to user: Instance 73bd8d03-ca91-4e95-b39a-f2e7e59f9390 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:54:50.815462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ca748042-3483-4c5b-a41b-7559e5c4c3a5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390" status: 404 len: 111 microversion: 2.1 time: 0.035719 Jun 30 15:54:50.815462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 293/581] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:50 2022] GET /compute/v2.1/servers/73bd8d03-ca91-4e95-b39a-f2e7e59f9390 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:54:51.432060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:51.433243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:51.443831 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:51.444685 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:51.445897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:51.446612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:51.583475 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:51.591903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fb74f4c6-2cee-4578-9f7a-04242d1af706 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.167844 Jun 30 15:54:51.592516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 289/582] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:51 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:52.613616 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:52.614627 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:52.623406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:52.623857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:52.624662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:52.625106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:52.774366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:52.783167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ce2e5105-665b-401c-ae6b-5dda2e772bf4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.176414 Jun 30 15:54:52.783706 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 294/583] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:52 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:53.801974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:53.802667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:53.810953 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:53.811485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:53.812444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:53.812960 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:53.947530 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:53.955838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e2c2e5b3-c56d-443a-af50-0293afd806b8 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.158501 Jun 30 15:54:53.956434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 290/584] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:53 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:54.977584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:54.978551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:54.990510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:54.991210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:54.992519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:54.993223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:55.128988 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:55.137275 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e221b6d9-e3ce-4cae-8e9e-3d52defea1e5 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.166172 Jun 30 15:54:55.137856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 295/585] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:54 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:56.161101 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:56.162061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:56.171425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:56.171852 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:56.172725 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:56.173165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:56.304637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:56.313789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-16d60665-d533-453d-a3f3-16269fa8aded tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.160784 Jun 30 15:54:56.314345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 291/586] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:56 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:57.334865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:57.335624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:57.346081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:57.346756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:57.347900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:57.348609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:57.497415 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:57.509585 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-375cccf1-9701-44b7-9e3e-b8255479c0de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.180591 Jun 30 15:54:57.510341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 296/587] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:57 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:58.527768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:58.528435 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:58.535620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:58.536103 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:58.536862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:58.537291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:58.541375 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:54:58.671886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:58.680482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e90f5a4e-233a-4a4d-b12d-26e3ae4b822a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.156642 Jun 30 15:54:58.681047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 292/588] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:58 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:54:59.698038 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:54:59.698756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:54:59.705996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:59.706440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:59.707227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:54:59.707655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:54:59.734784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2027168524", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "networks": [{"uuid": "09974abb-d757-428e-a03c-d9046575cdd5"}]}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:54:59.788722 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] validate_networks() for [('09974abb-d757-428e-a03c-d9046575cdd5', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:54:59.910003 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:54:59.919085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bcc38ce7-6cfe-4848-94a5-6eb63ebe04f0 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1735 microversion: 2.1 time: 0.224905 Jun 30 15:54:59.919682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 297/589] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:54:59 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:00.208536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:55:00.208959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:55:00.209422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:55:00.209857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:55:00.210292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:55:00.219434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:00.219878 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:00.220706 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:00.221140 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:00.238397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Getting quotas for project cf17d9690bf54b98815f00334a3470bc. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:55:00.242575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Getting quotas for user b9a7593adca849d49a95cec18d31ee14 and project cf17d9690bf54b98815f00334a3470bc. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:55:00.254311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:55:00.256574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:55:00.302249 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-aba3e68e-6ffe-4dbe-a5c7-320ed47faa40 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571659 Jun 30 15:55:00.302898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 293/590] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:55:00.312874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-95161190-a796-4f02-a5ae-16031015ec75 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:00.313559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-95161190-a796-4f02-a5ae-16031015ec75 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:00.315529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=62 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:00.371281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-95161190-a796-4f02-a5ae-16031015ec75 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:00.378213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-95161190-a796-4f02-a5ae-16031015ec75 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1219 microversion: 2.1 time: 0.069185 Jun 30 15:55:00.378777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 298/591] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:00 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:00.937105 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:00.937667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:00.947006 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:00.947460 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:00.948264 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:00.948703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.084626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:01.093389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-001d704a-8691-47a2-9f77-68a7ea64e9b6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1715 microversion: 2.1 time: 0.160779 Jun 30 15:55:01.093972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 294/592] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:00 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:01.197320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:01.197934 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:01.205067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.205514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.206275 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.206708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.293575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] HTTP exception thrown: Cannot 'detach_volume' instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 while it is in vm_state rescued Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Request method failure captured: Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments/a6f01809-0e1e-4715-bda1-1e87c81b4a13 HTTP/1.1 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZYVFSuUAxleG2k0a2OCamkz_RJtaY2Xq_DcljXOX2BcWa9SjeOxPb0obPYXgsefIxFkMfdwDV6nV6A8foadrrliK_obQfc2oAEj59w_Ahyk4C5lCCl3iEtB4l4C4Wagpi_bez67k_6QS6tcppzZISAD3XwBi0TxnHwznocqiCtYIs Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:55:01.295064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01a8c235ed97450bb8518af9d7dc1983", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: d30ffdb0374c4600a09476cfb3a07cb4 Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:55:01.296579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Cannot 'detach_volume' instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 while it is in vm_state rescued Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'server_id': '2a57f154-45c7-46ac-9822-bedfd64be7a2', 'id': 'a6f01809-0e1e-4715-bda1-1e87c81b4a13'} Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:55:01.297247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 while it is in vm_state rescued Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 while it is in vm_state rescued Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:01.298427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Returning 409 to user: Cannot 'detach_volume' instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 while it is in vm_state rescued {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:55:01.300131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3102cf7c-46cb-45fe-965c-f624c4120a0e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments/a6f01809-0e1e-4715-bda1-1e87c81b4a13" status: 409 len: 152 microversion: 2.1 time: 0.103325 Jun 30 15:55:01.300131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 299/593] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:55:01 2022] DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments/a6f01809-0e1e-4715-bda1-1e87c81b4a13 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 15:55:01.305526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:01.306055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:01.312232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.312683 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.313453 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.313889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.387712 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e80ef362-b453-4409-8af9-416280318cb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/action" status: 202 len: 0 microversion: 2.1 time: 0.085860 Jun 30 15:55:01.389489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 295/594] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:55:01 2022] POST /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:55:01.397767 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:01.398024 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:01.398736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:01.398964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:01.407160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.407606 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.409661 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.410174 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.410551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.411691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.412496 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:01.416804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:01.576902 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:01.584872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-eeca3e03-9c50-4830-a703-e4c53d48df13 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1279 microversion: 2.1 time: 0.191677 Jun 30 15:55:01.585681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 300/595] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:01 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:02.034888 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:02.043130 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1f605f3f-0535-4ac4-8e2a-8ee67dfccfcd tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1723 microversion: 2.1 time: 0.649212 Jun 30 15:55:02.043687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 296/596] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:01 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1723 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:02.602629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:02.603307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:02.611264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:02.611760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:02.612572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:02.612987 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:02.861804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:02.870080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6e9f3bc3-1c48-470a-b2a0-334643a9a1e1 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.271409 Jun 30 15:55:02.870713 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 301/597] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:02 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:03.061308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:03.061930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:03.069308 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:03.069751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:03.070528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:03.070968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:03.293981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:03.304017 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-90d8a0e7-f97f-4309-b978-94f6150160c2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1723 microversion: 2.1 time: 0.246912 Jun 30 15:55:03.304595 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 297/598] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:03 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:03.590700 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-a5bc4653-65cb-4cfb-a90a-8f73cc81aa77 req-40340e39-6ddf-45f5-b9e8-e7fd5db8f2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3dcf7d-8472-4555-a729-39bc70a5bb3d", "tag": "45e477ac-a76a-46c3-b4c9-3cec9a51f441"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:03.599171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a5bc4653-65cb-4cfb-a90a-8f73cc81aa77 req-40340e39-6ddf-45f5-b9e8-e7fd5db8f2db service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:03.599620 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a5bc4653-65cb-4cfb-a90a-8f73cc81aa77 req-40340e39-6ddf-45f5-b9e8-e7fd5db8f2db service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:03.615037 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-a5bc4653-65cb-4cfb-a90a-8f73cc81aa77 req-40340e39-6ddf-45f5-b9e8-e7fd5db8f2db service nova] Creating event network-changed:45e477ac-a76a-46c3-b4c9-3cec9a51f441 for instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d on hv-cinder-79760 Jun 30 15:55:03.619892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-a5bc4653-65cb-4cfb-a90a-8f73cc81aa77 req-40340e39-6ddf-45f5-b9e8-e7fd5db8f2db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032965 Jun 30 15:55:03.620668 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 302/599] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:03.891494 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:03.892534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:03.902706 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:03.903150 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:03.903911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:03.904374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:04.053907 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:04.062157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-396b04d2-e922-4801-b5fb-cbf58e20359d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.177300 Jun 30 15:55:04.062744 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 298/600] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:03 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:04.321964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:04.322658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:04.329566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:04.330008 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:04.330774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:04.331203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:04.480730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:04.489629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-35a3a1c2-b854-4326-9caa-63be0c623bee tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1723 microversion: 2.1 time: 0.171943 Jun 30 15:55:04.490206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 303/601] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:04 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:05.086965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:05.087920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:05.091755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:05.100917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:05.101659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:05.102907 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:05.103623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:05.245049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:05.253141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fdf967a7-1d26-490b-ab13-70c9e9666554 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.172820 Jun 30 15:55:05.253701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 299/602] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:05 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:05.507694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:05.508353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:05.515577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:05.515979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:05.516748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:05.517196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:05.747242 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:05.755950 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9f61542a-9e30-485a-808b-ba94d4bd9fed tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1723 microversion: 2.1 time: 0.252156 Jun 30 15:55:05.756567 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 304/603] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:05 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:06.273939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:06.274945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:06.282839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.283303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:06.284074 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.284508 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:06.428096 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:06.435926 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b8f66387-9334-4b45-9ac8-f0d5ab0bec8e tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.168874 Jun 30 15:55:06.436527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 300/604] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:06 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:06.780049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:06.781085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:06.790644 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.791307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:06.792395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.793079 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:06.940069 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:06.952055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-50adf535-916e-4625-8f83-5fefbf918f84 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1729 microversion: 2.1 time: 0.177936 Jun 30 15:55:06.952889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 305/605] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:06 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:06.973580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:06.974076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:06.980768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.981578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:06.982338 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:06.982774 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:07.067345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f4e15fbb-0fa5-4ff5-81e1-1410332fa185 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097648 Jun 30 15:55:07.067947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 301/606] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:55:06 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:07.453944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:07.454582 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:07.461349 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:07.461787 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:07.462575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:07.464031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:07.720192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:07.728021 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bdbfb355-2bf7-4b59-b8f9-c1eb0369bc74 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.278140 Jun 30 15:55:07.728579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 306/607] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:07 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:08.004373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-de7916c5-500b-4e65-a302-6b73eaa362a5 req-5a4fba50-951e-47b9-b854-d839f6c609e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:08.012847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-de7916c5-500b-4e65-a302-6b73eaa362a5 req-5a4fba50-951e-47b9-b854-d839f6c609e0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:08.013355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-de7916c5-500b-4e65-a302-6b73eaa362a5 req-5a4fba50-951e-47b9-b854-d839f6c609e0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:08.027315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-de7916c5-500b-4e65-a302-6b73eaa362a5 req-5a4fba50-951e-47b9-b854-d839f6c609e0 service nova] Creating event network-changed:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:55:08.033161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-de7916c5-500b-4e65-a302-6b73eaa362a5 req-5a4fba50-951e-47b9-b854-d839f6c609e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032892 Jun 30 15:55:08.033614 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 302/608] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:08.745466 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:08.746054 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:08.753218 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:08.753665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:08.754468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:08.754897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:08.891156 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:08.903329 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ce612d39-b8a2-42a1-9d7d-3d86fe45f3f5 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.161535 Jun 30 15:55:08.904104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 307/609] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:08 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:09.921231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:09.922288 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:09.930172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:09.930619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:09.931500 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:09.932025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:10.051758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-a144beb6-1064-4225-9433-0c86df79f63e req-199eb5d1-36bc-4c09-9461-4578e4991d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:10.060761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a144beb6-1064-4225-9433-0c86df79f63e req-199eb5d1-36bc-4c09-9461-4578e4991d7e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:10.061192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a144beb6-1064-4225-9433-0c86df79f63e req-199eb5d1-36bc-4c09-9461-4578e4991d7e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:10.066207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:10.072544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-a144beb6-1064-4225-9433-0c86df79f63e req-199eb5d1-36bc-4c09-9461-4578e4991d7e service nova] Creating event network-changed:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:55:10.073871 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-003510d4-6a1c-4ca5-bf95-ba7c13197357 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.157178 Jun 30 15:55:10.074509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 303/610] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:09 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:10.085762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-a144beb6-1064-4225-9433-0c86df79f63e req-199eb5d1-36bc-4c09-9461-4578e4991d7e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037838 Jun 30 15:55:10.086357 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 308/611] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:11.095169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:11.096145 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:11.099232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:11.100371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:11.112474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:11.113014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:11.114086 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:11.114704 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:11.263101 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:11.270713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c4df441a-c705-4016-a954-10c1cc81a65f tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.182204 Jun 30 15:55:11.271457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 304/612] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:11 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:11.446584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:11.451435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-15bd5e74-0d10-47ef-8e79-470d1bd1a9cb req-336c284d-530b-49f3-b0fe-94c9844a8636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3dcf7d-8472-4555-a729-39bc70a5bb3d", "name": "network-vif-plugged", "status": "completed", "tag": "45e477ac-a76a-46c3-b4c9-3cec9a51f441"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:11.460474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-15bd5e74-0d10-47ef-8e79-470d1bd1a9cb req-336c284d-530b-49f3-b0fe-94c9844a8636 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:11.460903 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-15bd5e74-0d10-47ef-8e79-470d1bd1a9cb req-336c284d-530b-49f3-b0fe-94c9844a8636 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:11.472227 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-15bd5e74-0d10-47ef-8e79-470d1bd1a9cb req-336c284d-530b-49f3-b0fe-94c9844a8636 service nova] Creating event network-vif-plugged:45e477ac-a76a-46c3-b4c9-3cec9a51f441 for instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d on hv-cinder-79760 Jun 30 15:55:11.476860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-15bd5e74-0d10-47ef-8e79-470d1bd1a9cb req-336c284d-530b-49f3-b0fe-94c9844a8636 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031094 Jun 30 15:55:11.477614 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 309/613] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:12.288301 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:12.288920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:12.295976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:12.296468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:12.297224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:12.297660 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:12.436464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:12.444279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5d70081a-0a28-4b89-8611-383c63110a39 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.159900 Jun 30 15:55:12.444852 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 305/614] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:12 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:13.466185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:13.467311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:13.477170 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:13.477810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:13.478992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:13.479643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:13.626904 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:13.634604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3776c599-f34b-41f5-941f-a80d2c23c595 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1319 microversion: 2.1 time: 0.175798 Jun 30 15:55:13.635192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 310/615] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:13 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:14.653915 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:14.654602 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:14.662385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:14.662827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:14.663581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:14.664026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:14.803928 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:14.813810 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-acc5760b-7c5b-4df8-abf5-8d081a14d4da tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1507 microversion: 2.1 time: 0.164966 Jun 30 15:55:14.814372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 306/616] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:14 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:14.830589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f7bc6b7-1e99-40dd-b4a2-e48ad5648ddb", "device": "/dev/sdb"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:14.831692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:14.838608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:14.839050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:14.839809 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:14.840399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:15.081493 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:15.104274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0a7afdcd-c2ea-454a-9091-1f5ffcc568b8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "POST /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277499 Jun 30 15:55:15.104888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 311/617] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:55:14 2022] POST /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:21.071174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:21.072837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:21.081021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:21.081472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:21.082237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:21.082669 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:21.162847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fd434eb9-2c2d-4919-8bfa-a51bba98f8c1 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action" status: 202 len: 0 microversion: 2.1 time: 0.097952 Jun 30 15:55:21.163812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 307/618] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:55:21 2022] POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:55:21.174152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:21.174856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:21.181773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:21.182225 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:21.182993 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:21.183445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:21.590348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:21.598877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-467c1b9b-0625-493a-b5ec-db4b35ff1654 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1751 microversion: 2.1 time: 0.430138 Jun 30 15:55:21.599446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 312/619] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:21 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1751 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:22.619639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:22.621012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:22.627883 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:22.628605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:22.629333 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:22.629769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:22.650271 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:22.797650 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:22.805947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-88735827-e376-49ed-91df-301cd1171d6e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1751 microversion: 2.1 time: 0.192811 Jun 30 15:55:22.806512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 308/620] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:22 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:23.822747 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:23.823396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:23.830353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:23.830854 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:23.831733 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:23.832205 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:23.981374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:23.989609 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-adb08bb7-0f2c-4083-83d2-9b4c1ae333bc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.170743 Jun 30 15:55:23.990204 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 313/621] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:23 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:25.017516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:25.018388 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:25.028893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:25.029337 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:25.030108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:25.030538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:25.183421 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:25.191807 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5c9d9aa7-32ab-4888-88f7-967cd237a427 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.181192 Jun 30 15:55:25.192414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 309/622] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:25 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:26.128274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:26.128951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:26.137811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.138406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.139422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.140026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.175533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8e6172c6-af23-47da-b2ea-0d84e60322bc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments/b8c8e6ad-3790-4564-b3b1-b509e50ae8da" status: 200 len: 194 microversion: 2.20 time: 0.052984 Jun 30 15:55:26.176175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 314/623] 10.222.0.50 () {60 vars in 1453 bytes} [Thu Jun 30 15:55:26 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments/b8c8e6ad-3790-4564-b3b1-b509e50ae8da => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:26.208773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:26.209391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:26.215918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.216412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.217177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.217638 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.241805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:26.242302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:26.248560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.249007 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.249759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.250186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.337109 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lazy-loading 'services' on Instance uuid 049d6e85-38af-4704-9533-28e68f38451c {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:55:26.372582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:26.380786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-999e064c-d281-4a10-a44c-139f832b5900 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.175899 Jun 30 15:55:26.381299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 310/624] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:26 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:26.412913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fce40473-638f-4ae4-afe2-cec4438f2bff tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments/b8c8e6ad-3790-4564-b3b1-b509e50ae8da" status: 202 len: 0 microversion: 2.20 time: 0.174885 Jun 30 15:55:26.413510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 315/625] 10.222.0.50 () {60 vars in 1456 bytes} [Thu Jun 30 15:55:26 2022] DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments/b8c8e6ad-3790-4564-b3b1-b509e50ae8da => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:55:26.422120 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:26.423076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:26.430351 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.430786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.431554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:26.432015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:26.461950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a71e553c-c5d7-4d01-aaf8-0ba1735aa686 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043756 Jun 30 15:55:26.462504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 311/626] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:55:26 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:27.400046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:27.400801 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:27.407782 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:27.408270 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:27.409027 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:27.409452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:27.475142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:27.476097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:27.483347 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:27.483800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:27.484593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:27.485059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:27.515653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-12f3992b-604b-42b1-a03a-5b1f436d13c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044504 Jun 30 15:55:27.516342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 312/627] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:55:27 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:27.563454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:27.572144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f88c056a-184d-4263-a7a5-31970eef2b21 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.177028 Jun 30 15:55:27.572683 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 316/628] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:27 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:28.529931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:28.531004 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:28.541275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:28.541876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:28.543008 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:28.543589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:28.573148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f3fc6bd3-fcef-4be1-870b-eb30d857d16a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048805 Jun 30 15:55:28.573696 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 313/629] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:55:28 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:28.589323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:28.589915 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:28.597028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:28.597478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:28.598242 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:28.598676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:28.755411 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:28.763774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bc677219-2f1e-4e26-8a0c-7d6ad69cff4c tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.178343 Jun 30 15:55:28.764370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 317/630] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:28 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:29.588902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:29.590359 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:29.597368 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:29.597805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:29.598571 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:29.599002 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:29.627927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-17acf7b8-1a55-4822-851c-78a4766c8591 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045872 Jun 30 15:55:29.628524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 314/631] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:55:29 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:29.785189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:29.786120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:29.797783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:29.798533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:29.799789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:29.800539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:29.950500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:29.958592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cc2e0a55-4224-4322-a2aa-a3570dbe2eff tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.180075 Jun 30 15:55:29.959161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 318/632] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:29 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:30.639921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:30.641016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:30.647750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.648252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.649079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.649517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.678985 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8be6cc0b-f716-4c10-a763-4706d6d38c28 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043191 Jun 30 15:55:30.679549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 315/633] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:55:30 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:30.737919 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:30.738418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:30.740437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=44 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:30.745892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.746339 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.747100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.747542 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.772786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:55:30.862634 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3f52bf54-076f-44ec-b298-d6c8cdcb837f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 204 len: 0 microversion: 2.20 time: 0.128253 Jun 30 15:55:30.866476 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 319/634] 10.222.0.50 () {60 vars in 1279 bytes} [Thu Jun 30 15:55:30 2022] DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 15:55:30.871743 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:30.872352 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:30.878484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.878931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.879687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.880178 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.975736 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:30.976464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:30.983281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.983748 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:30.984505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:30.984929 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:31.095052 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:31.103564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:31.105570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:31.106847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a7966e72-012a-48ca-a053-7c3fd87204be tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.239050 Jun 30 15:55:31.107484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 316/635] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:30 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:31.192256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:31.205293 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7d124673-6c97-421f-af88-5be0f3ba11c2 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.233837 Jun 30 15:55:31.206009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 320/636] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:30 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:55:32.129906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:32.130798 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:32.141478 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:32.142170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:32.143378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:32.144227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:32.225643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:32.226217 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:32.233729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:32.234856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:32.235625 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:32.236096 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:32.317754 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:32.326608 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:32.327889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:32.329076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e7a4b725-5eef-48c0-ae58-44d32aca80fd tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.205878 Jun 30 15:55:32.329822 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 317/637] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:32 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:32.396543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:32.408899 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-43053845-6441-43ca-b0e6-4229880738a7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.187141 Jun 30 15:55:32.409758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 321/638] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:32 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:55:33.347416 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:33.347793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:33.354038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:33.354483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:33.355596 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:33.356121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:33.426761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:33.427527 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:33.434301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:33.435044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:33.436671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:33.437199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:33.604514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:33.613318 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:33.615165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:33.616599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-07b713f0-3bd3-4023-bf97-6536c6033042 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 200 len: 1725 microversion: 2.20 time: 0.273862 Jun 30 15:55:33.617166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 318/639] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:33 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:33.722317 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:33.731834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-773e5960-1914-45e9-a382-e59d5db15bb6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.308909 Jun 30 15:55:33.732772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 322/640] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:33 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:33.950165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-0897fd18-8a4d-42e3-a7a8-87bc072a6b60 req-153821d1-bbd5-4cc1-aba8-12103ebc664f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d6e85-38af-4704-9533-28e68f38451c", "name": "network-vif-deleted", "tag": "b892f5b9-4c4d-4058-aeae-6021cdfafe28"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:33.958515 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0897fd18-8a4d-42e3-a7a8-87bc072a6b60 req-153821d1-bbd5-4cc1-aba8-12103ebc664f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:33.959249 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-0897fd18-8a4d-42e3-a7a8-87bc072a6b60 req-153821d1-bbd5-4cc1-aba8-12103ebc664f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:33.971532 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-0897fd18-8a4d-42e3-a7a8-87bc072a6b60 req-153821d1-bbd5-4cc1-aba8-12103ebc664f service nova] Creating event network-vif-deleted:b892f5b9-4c4d-4058-aeae-6021cdfafe28 for instance 049d6e85-38af-4704-9533-28e68f38451c on hv-cinder-79760 Jun 30 15:55:33.976728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-0897fd18-8a4d-42e3-a7a8-87bc072a6b60 req-153821d1-bbd5-4cc1-aba8-12103ebc664f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030460 Jun 30 15:55:33.977954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 319/641] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:34.586071 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:34.586631 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:34.593312 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.593887 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.594654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.595080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.637551 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:34.644095 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:34.661114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.661753 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.662686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.663262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.690377 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c HTTP/1.1 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:55:34.691910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:55:34.693758 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '049d6e85-38af-4704-9533-28e68f38451c'} Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:55:34.694687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:55:34.696589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:34.698850 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:55:34.705593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-89a8e4d3-49f0-4a20-961b-be73ee2f0c1b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 404 len: 111 microversion: 2.20 time: 0.072319 Jun 30 15:55:34.708064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 320/642] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:34 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:55:34.714928 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-48d7c89d-da42-4555-8f12-af5a122ea4f2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '.version_select at 0x7fbbdb015ee0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:34.723575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lazy-loading 'services' on Instance uuid ef3dcf7d-8472-4555-a729-39bc70a5bb3d {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:55:34.738284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-48d7c89d-da42-4555-8f12-af5a122ea4f2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-578920292" status: 204 len: 0 microversion: 2.20 time: 0.027099 Jun 30 15:55:34.753238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 321/643] 10.222.0.50 () {60 vars in 1258 bytes} [Thu Jun 30 15:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-578920292 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 30 15:55:34.763387 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:34.766626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:34.783123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.783565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.784621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:34.784994 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:34.814167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0ea36d4e-e6b0-46b3-a7c0-bd1037b5ceea tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d/os-volume_attachments/5f7bc6b7-1e99-40dd-b4a2-e48ad5648ddb" status: 202 len: 0 microversion: 2.1 time: 0.233199 Jun 30 15:55:34.814975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 323/644] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:55:34 2022] DELETE /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d/os-volume_attachments/5f7bc6b7-1e99-40dd-b4a2-e48ad5648ddb => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:55:35.037773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:35.046367 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-85ae5f69-a031-4dbd-9210-76ad4954360d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.290804 Jun 30 15:55:35.047287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 322/645] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:34 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:35.581062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d66d035e-7698-4c32-b7d7-534fd06c848b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: .version_select at 0x7fbbda4389d0>, body: {"keypair": {"name": "tempest-keypair-445147154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEpiCBpGR6DMjQ3nwHEUsJAMvVJD/8fl122LYPg5MuS6JSzAL7vmOoCOoTSmRcvH4JHwKYv/IY+gdFyUxCjdnaXKM+UN5cc9uAsMIpi3E7zUOlmpGT6Ms5DhDUxqYwp8Q=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:35.596219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-d66d035e-7698-4c32-b7d7-534fd06c848b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:55:35.600155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-d66d035e-7698-4c32-b7d7-534fd06c848b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for user 7f2f23e763704ce2b0969e24ffde9243 and project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:55:35.624869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d66d035e-7698-4c32-b7d7-534fd06c848b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048231 Jun 30 15:55:35.625806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 324/646] 10.222.0.50 () {62 vars in 1199 bytes} [Thu Jun 30 15:55:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 15:55:35.969411 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:35.970606 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:35.974019 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:35.982404 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:35.983176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:35.984239 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:35.984889 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:36.012038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:55:36.072036 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:36.074505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:36.085222 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:36.085794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:36.097273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:36.097727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:36.110207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-53a736bc-6a37-4f9e-933d-8a654275dc10 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 204 len: 0 microversion: 2.1 time: 0.144404 Jun 30 15:55:36.112445 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 323/647] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:55:35 2022] DELETE /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:55:36.122288 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:36.123497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:36.132165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:36.132735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:36.133627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:36.134153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:36.316694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:36.321882 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:36.325621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-72608b6c-4334-4347-bf86-a90d414487b0 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1513 microversion: 2.1 time: 0.207593 Jun 30 15:55:36.325770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=94,nova_cell1:INSERT=4 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:36.325886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 324/648] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:36 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:36.331729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fece7e2a-9708-44f7-baa1-347722f966ad tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.270408 Jun 30 15:55:36.341064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 325/649] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:36 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:37.015665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2057202615", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b601c7e-ccdb-42e6-964c-f43a3e4438dc"}], "security_groups": [{"name": "tempest-securitygroup--2083493223"}], "key_name": "tempest-keypair-445147154", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:37.118959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] validate_networks() for [('0b601c7e-ccdb-42e6-964c-f43a3e4438dc', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:55:37.342968 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:37.343710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:37.351982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.352459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.353224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.353653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.562975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:37.564708 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:55:37.565342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:55:37.565825 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:55:37.566240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:55:37.566654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:55:37.570820 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9ff44fad-dd4d-4a46-a739-8e176d5b41c8 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1513 microversion: 2.1 time: 0.231814 Jun 30 15:55:37.571390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 326/650] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:37 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:37.575845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:37.576496 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:37.580940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.581415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.582201 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.582612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.582744 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.583069 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.583830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:37.584313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:37.599683 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:55:37.603856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Getting quotas for user 7f2f23e763704ce2b0969e24ffde9243 and project f88ea20d31df42ec9e28d8f283aa15ec. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:55:37.616875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:55:37.619147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:55:37.666386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f4257ca1-f753-43e3-a3f5-fa32751eebd2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.656412 Jun 30 15:55:37.667213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 325/651] 10.222.0.50 () {62 vars in 1187 bytes} [Thu Jun 30 15:55:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 15:55:37.677078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:37.677852 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:37.746644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:37.754752 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:37.756293 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:37.757694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1e250078-aef1-4679-ab03-340179ac557d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1281 microversion: 2.20 time: 0.084374 Jun 30 15:55:37.758278 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 326/652] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:37 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:37.763266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:37.772981 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-45697690-83a4-44b2-baf8-0cde89eaaf4f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.200433 Jun 30 15:55:37.773847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 327/653] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:37 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:38.591194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:38.592427 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:38.599226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:38.599665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:38.600449 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:38.600876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:38.620998 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:38.775187 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:38.775826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:38.783318 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:38.783791 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:38.784619 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:38.785048 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:39.068120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:39.078838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:39.080804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:39.081983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-207c6c41-564d-471b-ad23-ed0df5b64165 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1333 microversion: 2.20 time: 0.310836 Jun 30 15:55:39.082908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 328/654] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:38 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1333 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:39.093560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:39.093560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:39.101444 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:39.101961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:39.103049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:39.103509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:39.385332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:39.393283 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3f06d37a-eec0-455c-8451-f5e12eff6a97 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1513 microversion: 2.1 time: 0.807973 Jun 30 15:55:39.393868 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 327/655] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:38 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1513 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:39.590186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:39.599321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0e0dd1e1-914e-4b01-81b0-05cc04d26104 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.513692 Jun 30 15:55:39.599899 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 329/656] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:39 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:40.099828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:40.100458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:40.108100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.108610 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.109518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.110011 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.220331 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:40.230080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:40.231648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:40.232933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-96741372-446f-4c7a-967a-79e18b38fa50 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1339 microversion: 2.20 time: 0.137079 Jun 30 15:55:40.233487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 328/657] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:40 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1339 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:40.246708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-6a73c19a-28c2-42dc-ac85-10fba209bcaf req-524fcc4b-ec72-4521-b7e5-c13c875265c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3dcf7d-8472-4555-a729-39bc70a5bb3d", "name": "network-vif-deleted", "tag": "45e477ac-a76a-46c3-b4c9-3cec9a51f441"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:40.257471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6a73c19a-28c2-42dc-ac85-10fba209bcaf req-524fcc4b-ec72-4521-b7e5-c13c875265c8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.257926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-6a73c19a-28c2-42dc-ac85-10fba209bcaf req-524fcc4b-ec72-4521-b7e5-c13c875265c8 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.271941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-6a73c19a-28c2-42dc-ac85-10fba209bcaf req-524fcc4b-ec72-4521-b7e5-c13c875265c8 service nova] Creating event network-vif-deleted:45e477ac-a76a-46c3-b4c9-3cec9a51f441 for instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d on hv-cinder-79760 Jun 30 15:55:40.277129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-6a73c19a-28c2-42dc-ac85-10fba209bcaf req-524fcc4b-ec72-4521-b7e5-c13c875265c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Jun 30 15:55:40.277689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 330/658] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:55:40.410695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:40.411306 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:40.427580 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.428046 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.428837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.429311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.519487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a7593adca849d49a95cec18d31ee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf17d9690bf54b98815f00334a3470bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:40.547215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-78113a23-65c1-4234-b52d-ddce626ca1d6 tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 200 len: 1304 microversion: 2.1 time: 0.140218 Jun 30 15:55:40.547813 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 329/659] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:40 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:40.617454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:40.618151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:40.624818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.625333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.626111 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:40.626535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:40.772022 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:40.781095 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-37252f9a-9ef4-4098-9a5e-3db8da032e3f tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.167944 Jun 30 15:55:40.781661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 331/660] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:40 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:41.251919 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:41.252573 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:41.259686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.260174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:41.260957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.261394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:41.497996 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:41.507653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:41.509574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:41.510680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-15c14073-b590-4b6f-b37d-65024ae4da72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.263349 Jun 30 15:55:41.511654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 330/661] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:41 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:41.565305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:41.565977 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] [instance: ef3dcf7d-8472-4555-a729-39bc70a5bb3d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:41.572670 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.573120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:41.573888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.574323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:41.589422 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] HTTP exception thrown: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Request method failure captured: Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d HTTP/1.1 Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbpUwQaWbiMy-ue5kJJq0JgDAHWeNR34UHQRRAydC0Iar9o6FOvGPIFYKB7wvaGFXizq927WvDfy44eFFa2L16WTlQSU_Mh-byJ6e_Jf09jSTJOwadwCAzkwfby58An-uPGiIQXdreawac4v1Vdl5fzFlRjVbJVSMpaciwFlNhRnMo Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: cf17d9690bf54b98815f00334a3470bc Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:55:41.591049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf17d9690bf54b98815f00334a3470bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf17d9690bf54b98815f00334a3470bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: cf17d9690bf54b98815f00334a3470bc Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-169065257 Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesSnapshotTestJSON-169065257-project Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: b9a7593adca849d49a95cec18d31ee14 Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesSnapshotTestJSON-169065257-project Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. Jun 30 15:55:41.593648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'ef3dcf7d-8472-4555-a729-39bc70a5bb3d'} Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:55:41.594461 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. Jun 30 15:55:41.595685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:55:41.596810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] Returning 404 to user: Instance ef3dcf7d-8472-4555-a729-39bc70a5bb3d could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:55:41.596810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c44de6db-b535-4e91-9298-928c6c2ee01d tempest-VolumesSnapshotTestJSON-169065257 tempest-VolumesSnapshotTestJSON-169065257-project] 10.222.0.50 "GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d" status: 404 len: 111 microversion: 2.1 time: 0.031769 Jun 30 15:55:41.596810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 332/662] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:41 2022] GET /compute/v2.1/servers/ef3dcf7d-8472-4555-a729-39bc70a5bb3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:55:41.799046 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:41.800093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:41.806957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.807670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:41.808499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:41.808924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.033014 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:42.034666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:42.041266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.041711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.042482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.042912 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.071764 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bfec8f9e-3b42-4c8d-9f4a-d38605d9937b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044635 Jun 30 15:55:42.072341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 333/663] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:55:42 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:55:42.087898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:42.096245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-668bd7f2-5b01-4e91-b286-36f03d783a16 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.301741 Jun 30 15:55:42.096816 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 331/664] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:41 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:42.132048 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:42.132590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:42.139037 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.139478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.140378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.140803 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.165793 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:55:42.246591 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2d40cda8-4b72-4266-9055-7d6e3c6ec1b8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 204 len: 0 microversion: 2.1 time: 0.118566 Jun 30 15:55:42.247204 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 334/665] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:55:42 2022] DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:55:42.260736 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:42.261345 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:42.268479 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.268931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.269696 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.270160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.297769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-c3d82406-b72b-4b89-8dbd-5ac353323365 req-94427555-4db3-481d-8151-7b63fc3796fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:42.306579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-c3d82406-b72b-4b89-8dbd-5ac353323365 req-94427555-4db3-481d-8151-7b63fc3796fe service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.307067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-c3d82406-b72b-4b89-8dbd-5ac353323365 req-94427555-4db3-481d-8151-7b63fc3796fe service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.318858 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-c3d82406-b72b-4b89-8dbd-5ac353323365 req-94427555-4db3-481d-8151-7b63fc3796fe service nova] Creating event network-changed:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:55:42.323906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-c3d82406-b72b-4b89-8dbd-5ac353323365 req-94427555-4db3-481d-8151-7b63fc3796fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030685 Jun 30 15:55:42.324850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 335/666] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:42.405767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:42.414081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8c96ed68-00fa-43ae-86d9-a9c1764528d2 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1676 microversion: 2.1 time: 0.157413 Jun 30 15:55:42.414645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 332/667] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:42 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:42.531431 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:42.533223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:42.541838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.542392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.543342 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:42.543867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:42.701437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:42.710027 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:42.711537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:42.712686 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-94e51158-5d0a-44a7-9549-4be304f1a6a4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.186706 Jun 30 15:55:42.713246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 336/668] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:42 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:43.113600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:43.114330 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:43.120577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.121230 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:43.122572 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.123183 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:43.280262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:43.293247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-58ab1086-a437-4bf1-9867-5da74bb39888 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.183352 Jun 30 15:55:43.293828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 333/669] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:43 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:55:43.431116 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:43.431730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:43.438259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.438768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:43.439566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.440036 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:43.573371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:43.581518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0ef89549-c9a3-423c-afa5-a56a0f8e2239 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1676 microversion: 2.1 time: 0.154427 Jun 30 15:55:43.582121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 337/670] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:43 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:43.735651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:43.736693 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:43.746959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.747700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:43.748984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:43.749790 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:44.155780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:44.168512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:44.170905 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:44.172179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be063d76-cd56-47cf-8639-9bbdcf4fb3e2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.443924 Jun 30 15:55:44.172735 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 334/671] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:43 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:44.311682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:44.312326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:44.319086 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:44.319535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:44.320348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:44.320777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:44.463258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:44.471571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2a9627fa-050a-4390-aa2f-6f1dad08595a tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.163893 Jun 30 15:55:44.472157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 338/672] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:44 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:44.603484 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:44.604894 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:44.615922 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:44.616720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:44.618014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:44.618705 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:44.753747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:44.761962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-39a5ce62-6ff1-43a8-bdba-3d5d26618fba tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1676 microversion: 2.1 time: 0.165168 Jun 30 15:55:44.762536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 335/673] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:44 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:45.193335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:45.193971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:45.203526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.203973 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.204761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.205186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.333718 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:45.341681 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:45.343263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:45.344390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f942ffc6-227c-478e-8299-38003e4cf7d0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.156936 Jun 30 15:55:45.345072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 339/674] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:45 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:45.493622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:45.494614 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:45.503141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.503589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.504375 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.504803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.658459 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:45.666652 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-616727dd-5bb0-417e-868f-cf76a0cdbe20 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.179471 Jun 30 15:55:45.667195 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 336/675] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:45 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:45.783687 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:45.784606 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:45.787770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=4 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:45.796970 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.797417 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.798191 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:45.798630 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:45.940683 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:45.948246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-173b588a-9e9e-4c48-8680-cf0184618d19 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1676 microversion: 2.1 time: 0.171221 Jun 30 15:55:45.948806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 340/676] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:45 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:46.362698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:46.363394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:46.369768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.370281 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:46.371105 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.371594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:46.651778 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:46.664151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:46.666617 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:46.667938 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-95e02f31-fa05-4012-a08b-1ded09504b0a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.309210 Jun 30 15:55:46.669168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 337/677] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:46 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:46.686007 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:46.687223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:46.695401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.695893 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:46.696827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.697122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:46.967282 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:46.967932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:46.974448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.974899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:46.975665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:46.976129 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:47.058305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:47.071064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-803da895-ab20-45ed-be33-b47e8377b6b7 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1756 microversion: 2.1 time: 0.390382 Jun 30 15:55:47.072186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 341/678] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:46 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1756 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:47.242918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:47.251210 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fdf56051-33a9-4333-bfbc-4dc49f1b2f27 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1676 microversion: 2.1 time: 0.287919 Jun 30 15:55:47.251786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 338/679] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:46 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:47.688506 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:47.689119 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:47.695917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:47.696418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:47.697198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:47.697770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:47.832351 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-d3034845-f4e2-49af-b2cb-fc9a85d4e3c2 req-8bb54a56-68aa-43af-9442-478a54a5e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:47.836855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:47.838430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=8 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:47.849970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d3034845-f4e2-49af-b2cb-fc9a85d4e3c2 req-8bb54a56-68aa-43af-9442-478a54a5e71e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:47.850599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d3034845-f4e2-49af-b2cb-fc9a85d4e3c2 req-8bb54a56-68aa-43af-9442-478a54a5e71e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:47.878729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-d3034845-f4e2-49af-b2cb-fc9a85d4e3c2 req-8bb54a56-68aa-43af-9442-478a54a5e71e service nova] Creating event network-vif-plugged:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:55:47.888039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-d3034845-f4e2-49af-b2cb-fc9a85d4e3c2 req-8bb54a56-68aa-43af-9442-478a54a5e71e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059202 Jun 30 15:55:47.889250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 339/680] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:48.063044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-ab85cb06-5186-4059-a5a1-e95c64d63a01 req-012ceb7f-a269-4173-9f81-acf54e94159b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85185f0-6858-4750-a044-9c3dc44d0240", "name": "network-vif-deleted", "tag": "b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:48.064354 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:48.069746 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:48.080858 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ab85cb06-5186-4059-a5a1-e95c64d63a01 req-012ceb7f-a269-4173-9f81-acf54e94159b service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.081424 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ab85cb06-5186-4059-a5a1-e95c64d63a01 req-012ceb7f-a269-4173-9f81-acf54e94159b service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.089613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:48.094075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:48.094839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-ab85cb06-5186-4059-a5a1-e95c64d63a01 req-012ceb7f-a269-4173-9f81-acf54e94159b service nova] Creating event network-vif-deleted:b4ec91c8-13d9-42ea-b26f-f63fa5c9fae8 for instance b85185f0-6858-4750-a044-9c3dc44d0240 on hv-cinder-79760 Jun 30 15:55:48.095315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5a4fc42f-0a34-43a9-8d5a-b1eab969d7e9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.411192 Jun 30 15:55:48.095891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 342/681] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:47 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:48.103596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:48.105403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:48.117607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-ab85cb06-5186-4059-a5a1-e95c64d63a01 req-012ceb7f-a269-4173-9f81-acf54e94159b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067218 Jun 30 15:55:48.119840 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 340/682] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:48.141828 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.142280 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.143946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.144462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.269436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:48.270136 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:48.280780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.281305 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.282362 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.283357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.329089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:48.329538 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:48.330157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lazy-loading 'fault' on Instance uuid b85185f0-6858-4750-a044-9c3dc44d0240 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:55:48.338096 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:48.348011 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1a1e93fa-6ac8-46d7-b589-a57b38378161 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1759 microversion: 2.1 time: 0.249081 Jun 30 15:55:48.361228 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 343/683] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:48 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1759 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:48.373902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:48.382025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-de76b352-fd9a-4021-b9bc-b249e61b6499 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 200 len: 1328 microversion: 2.1 time: 0.116786 Jun 30 15:55:48.382600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 341/684] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:48 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:55:49.114128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:49.114728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:49.121353 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:49.121795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:49.122551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:49.122978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:49.169999 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 15:55:49.170537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 15:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c (ip 10.222.0.50) !!! Jun 30 15:55:49.319860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:49.328326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:49.329951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:49.331148 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-823399eb-10ba-45d4-8467-096e3422ab2e tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1407 microversion: 2.20 time: 0.221053 Jun 30 15:55:49.331673 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 344/685] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:49 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:55:49.399245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:49.399897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:49.406620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:49.407057 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:49.407802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:49.408266 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:49.424868 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 HTTP/1.1 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:55:49.426514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:55:49.428026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'b85185f0-6858-4750-a044-9c3dc44d0240'} Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:55:49.428946 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:55:49.430497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:55:49.431860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:55:49.431860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fed2bd63-7503-44f0-aadf-ef5f978b58f5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 404 len: 111 microversion: 2.1 time: 0.032644 Jun 30 15:55:49.431860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 342/686] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:49 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:55:49.437110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-66b9c77b-fbfd-4020-848a-5d313d74e294 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '.version_select at 0x7fbbda442f70>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:49.458394 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-66b9c77b-fbfd-4020-848a-5d313d74e294 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127763730" status: 202 len: 0 microversion: 2.1 time: 0.025023 Jun 30 15:55:49.459182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 345/687] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 15:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127763730 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:55:50.118357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8d85bd1f-aec0-4630-b166-6a74a3cc53a9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: .version_select at 0x7fbbda69bf70>, body: {"keypair": {"name": "tempest-keypair-1367321771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ0XRRpWoXvt1uAqstrHQlx42cQtnCNWMJz/CIIHChwUM9IkLevNaEI9h1vEEvoB8daYVN0dzdFkANwQYYeK/vSwbRx+Ohyrf3b1q9jpc76bgIgxokYjIWDg3xLYyvQwA=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:50.132690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-8d85bd1f-aec0-4630-b166-6a74a3cc53a9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for project 9874821533c3446c9d71a65fb5b8e703. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:55:50.136804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-8d85bd1f-aec0-4630-b166-6a74a3cc53a9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for user 2f3c67a263b14158a01fd906a31696cd and project 9874821533c3446c9d71a65fb5b8e703. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:55:50.161938 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8d85bd1f-aec0-4630-b166-6a74a3cc53a9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048199 Jun 30 15:55:50.162524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 343/688] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:55:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:50.349345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:50.350564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:50.358179 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:50.358682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:50.359622 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:50.360234 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:50.522307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:50.530641 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:50.532193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:50.533358 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c5462003-fc80-496c-a5fc-229c237a44ed tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1599 microversion: 2.20 time: 0.188055 Jun 30 15:55:50.533909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 346/689] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:55:50 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:55:50.551187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:50.551750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:50.558329 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:50.558769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:50.559517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:50.559939 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:50.644255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ab1d19a0-f167-47f0-aa13-27998a356c76 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097410 Jun 30 15:55:50.644853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 344/690] 10.222.0.50 () {60 vars in 1315 bytes} [Thu Jun 30 15:55:50 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:55:51.506826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1449495904", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffa3f10e-dbc8-4043-9c4c-52b5028d6c41"}], "security_groups": [{"name": "tempest-securitygroup--1291185420"}], "key_name": "tempest-keypair-1367321771", "user_data": "}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:51.633313 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] validate_networks() for [('ffa3f10e-dbc8-4043-9c4c-52b5028d6c41', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:55:52.034764 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-62018d61-6595-4d69-8559-8af9d9213779 req-1f2e1cf3-0b21-476a-9ce3-6e8bb3b53d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:52.044512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-62018d61-6595-4d69-8559-8af9d9213779 req-1f2e1cf3-0b21-476a-9ce3-6e8bb3b53d5d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:52.045315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-62018d61-6595-4d69-8559-8af9d9213779 req-1f2e1cf3-0b21-476a-9ce3-6e8bb3b53d5d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:52.059593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-62018d61-6595-4d69-8559-8af9d9213779 req-1f2e1cf3-0b21-476a-9ce3-6e8bb3b53d5d service nova] Creating event network-changed:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:55:52.065968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-62018d61-6595-4d69-8559-8af9d9213779 req-1f2e1cf3-0b21-476a-9ce3-6e8bb3b53d5d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036129 Jun 30 15:55:52.067287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 345/691] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:55:52.224882 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:55:52.225395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:55:52.225881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:55:52.226292 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:55:52.226703 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:55:52.236973 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:52.237423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:52.238219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:52.238658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:52.256635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for project 9874821533c3446c9d71a65fb5b8e703. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:55:52.261453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Getting quotas for user 2f3c67a263b14158a01fd906a31696cd and project 9874821533c3446c9d71a65fb5b8e703. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:55:52.279418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:55:52.282019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:55:52.334750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-251eb835-d276-496c-8b3b-cb90fb612ae8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.832470 Jun 30 15:55:52.336144 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 347/692] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:55:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:55:52.346659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-63bef045-b52d-415d-b551-4c949c008484 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:52.347343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-63bef045-b52d-415d-b551-4c949c008484 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:52.404802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-63bef045-b52d-415d-b551-4c949c008484 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:52.412397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-63bef045-b52d-415d-b551-4c949c008484 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1238 microversion: 2.1 time: 0.070208 Jun 30 15:55:52.413496 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 346/693] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:52 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:53.435198 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:53.436189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:53.447829 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:53.448624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:53.449867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:53.450587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:53.514147 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:53.523101 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c797b353-c350-4e86-a26b-b738068deb98 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1242 microversion: 2.1 time: 0.095422 Jun 30 15:55:53.523661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 348/694] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:53 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:54.540841 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:54.542573 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:54.554183 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:54.554907 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:54.556274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:54.556800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:54.649151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:54.657375 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0a0fa3c2-0f8c-45b2-9d03-bfb76201f1a5 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1296 microversion: 2.1 time: 0.120446 Jun 30 15:55:54.658596 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 347/695] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:54 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:55.414212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:55.415016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:55.417381 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:55.422922 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.423373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.424181 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.424639 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.512470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'services' on Instance uuid 2a57f154-45c7-46ac-9822-bedfd64be7a2 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:55:55.588462 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-364404fa-5470-4c30-8fab-25485a37ae49 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments/a6f01809-0e1e-4715-bda1-1e87c81b4a13" status: 202 len: 0 microversion: 2.1 time: 0.177971 Jun 30 15:55:55.589324 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 349/696] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:55:55 2022] DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments/a6f01809-0e1e-4715-bda1-1e87c81b4a13 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 15:55:55.600141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:55.601065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:55.607517 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.607843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.608747 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.609350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.640674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:55.645964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3ae5cda5-0248-40a7-9912-1c93d196e089 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052157 Jun 30 15:55:55.646536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 348/697] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:55:55 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:55:55.675483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:55.676246 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:55.682740 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.683187 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.683960 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:55.684415 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:55.895612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:55.903304 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-23ecca38-7b62-4c71-9349-7793730ad4c9 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.232146 Jun 30 15:55:55.903844 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 350/698] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:55 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:56.026729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-65cf8c43-4d14-435d-bcce-e8e1cef6b1d6 req-a24a8c38-f8a7-4584-89a6-d274e41dfd61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b19b9d-b5ed-46a3-915f-282c65bf910b", "tag": "39a6c862-9e37-406e-98d9-a8a2ee9d4cd0"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:55:56.041506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-65cf8c43-4d14-435d-bcce-e8e1cef6b1d6 req-a24a8c38-f8a7-4584-89a6-d274e41dfd61 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.042867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-65cf8c43-4d14-435d-bcce-e8e1cef6b1d6 req-a24a8c38-f8a7-4584-89a6-d274e41dfd61 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.057237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-65cf8c43-4d14-435d-bcce-e8e1cef6b1d6 req-a24a8c38-f8a7-4584-89a6-d274e41dfd61 service nova] Creating event network-changed:39a6c862-9e37-406e-98d9-a8a2ee9d4cd0 for instance 40b19b9d-b5ed-46a3-915f-282c65bf910b on hv-cinder-79760 Jun 30 15:55:56.062297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-65cf8c43-4d14-435d-bcce-e8e1cef6b1d6 req-a24a8c38-f8a7-4584-89a6-d274e41dfd61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039065 Jun 30 15:55:56.062920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 349/699] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:55:56.659374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:56.660386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:56.667177 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.667586 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.668367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.668799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.699327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ac0929c3-5846-4672-bcd9-6d5419df7b12 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044694 Jun 30 15:55:56.699867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 351/700] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:55:56 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:55:56.781585 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:56.782154 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:56.788514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.788920 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.789699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.790112 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.814925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:55:56.897463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f4f9aade-8edc-4d9a-882f-23f710632729 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 204 len: 0 microversion: 2.1 time: 0.120591 Jun 30 15:55:56.898110 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 350/701] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:55:56 2022] DELETE /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:55:56.908758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:56.909642 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:56.917114 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.917617 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.918328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.918761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.920984 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:56.921688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:56.923634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:55:56.929471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.929918 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:56.930684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:56.931119 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:57.122338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:57.126128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:57.130196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0e81642e-40e1-4974-be5f-b2de568cd74d tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1689 microversion: 2.1 time: 0.227512 Jun 30 15:55:57.130774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 352/702] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:56 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:57.133596 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f8735152-f38f-4afe-96b9-77e9e3d590c7 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.216706 Jun 30 15:55:57.134148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 351/703] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:56 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:55:58.147086 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:58.147721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:58.150665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:58.151395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:58.156090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:58.156664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:58.157546 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:58.158050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:58.158390 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:58.158853 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:58.159592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:58.160015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:58.362870 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:58.366399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:58.372728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-11bdda88-8806-485e-98c1-4ec3737f5576 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.225783 Jun 30 15:55:58.373752 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 352/704] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:58 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:58.376297 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5edfceab-a773-4887-9925-5d486e431986 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1689 microversion: 2.1 time: 0.233096 Jun 30 15:55:58.376836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 353/705] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:58 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:59.393713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:59.394452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:59.395577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:55:59.396378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:55:59.402985 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:59.403463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:59.404245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:59.404457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:59.404804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:59.405143 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:59.405919 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:55:59.406451 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:55:59.606741 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:59.613290 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:55:59.615018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2c1c2d86-d022-4612-b019-b0447872ec5a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.227007 Jun 30 15:55:59.615782 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 353/706] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:59 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:55:59.622106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-82d3aa9d-8129-48f4-bd24-f9389da30e18 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1689 microversion: 2.1 time: 0.231350 Jun 30 15:55:59.622665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 354/707] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:55:59 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:00.634190 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:00.635058 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:00.639744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:00.640403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:00.644266 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:00.644711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:00.645489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:00.645921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:00.647080 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:00.647525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:00.648303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:00.648810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:01.117430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:01.124255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:01.127577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-82919ebe-9216-43ae-a0c1-8da07f745eb4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1689 microversion: 2.1 time: 0.492339 Jun 30 15:56:01.128613 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 355/708] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:00 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1689 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:01.138612 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ff792e1c-98a1-4bac-902c-f699b46c3597 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.508345 Jun 30 15:56:01.140079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 354/709] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:00 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:01.697696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-133a8e2a-178b-450f-afcb-fdf5c3fc429e req-deb6ca34-13f3-462f-8bb9-42a007f827d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b19b9d-b5ed-46a3-915f-282c65bf910b", "name": "network-vif-plugged", "status": "completed", "tag": "39a6c862-9e37-406e-98d9-a8a2ee9d4cd0"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:01.706977 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-133a8e2a-178b-450f-afcb-fdf5c3fc429e req-deb6ca34-13f3-462f-8bb9-42a007f827d7 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:01.707379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-133a8e2a-178b-450f-afcb-fdf5c3fc429e req-deb6ca34-13f3-462f-8bb9-42a007f827d7 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:01.718976 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-133a8e2a-178b-450f-afcb-fdf5c3fc429e req-deb6ca34-13f3-462f-8bb9-42a007f827d7 service nova] Creating event network-vif-plugged:39a6c862-9e37-406e-98d9-a8a2ee9d4cd0 for instance 40b19b9d-b5ed-46a3-915f-282c65bf910b on hv-cinder-79760 Jun 30 15:56:01.725320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-133a8e2a-178b-450f-afcb-fdf5c3fc429e req-deb6ca34-13f3-462f-8bb9-42a007f827d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jun 30 15:56:01.725320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 356/710] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:02.152777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:02.159111 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:02.159811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:02.160762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:02.171982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:02.172229 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:02.172671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:02.172843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:02.173762 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:02.173916 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:02.174383 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:02.174529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:02.246253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:02.277471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:02.409893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:02.489944 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:02.497997 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b6344b29-1c53-462a-8bdc-9a6b689af22c tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1689 microversion: 2.1 time: 0.349234 Jun 30 15:56:02.498644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 355/711] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:02 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1689 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:02.503816 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:02.511751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-74e8a56d-54ed-421f-b5a6-fc22e15c7748 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.357012 Jun 30 15:56:02.512426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 357/712] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:02 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:03.009408 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-9851f687-2e51-4930-8d1a-89cd4ae169b4 req-b55d0352-8297-4dfc-a554-610adf9b447e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a57f154-45c7-46ac-9822-bedfd64be7a2", "name": "network-vif-deleted", "tag": "03c28ba9-7d91-419c-bdaf-3c1dca122780"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:03.017453 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-9851f687-2e51-4930-8d1a-89cd4ae169b4 req-b55d0352-8297-4dfc-a554-610adf9b447e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.017912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-9851f687-2e51-4930-8d1a-89cd4ae169b4 req-b55d0352-8297-4dfc-a554-610adf9b447e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.029632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-9851f687-2e51-4930-8d1a-89cd4ae169b4 req-b55d0352-8297-4dfc-a554-610adf9b447e service nova] Creating event network-vif-deleted:03c28ba9-7d91-419c-bdaf-3c1dca122780 for instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 on hv-cinder-79760 Jun 30 15:56:03.035609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-9851f687-2e51-4930-8d1a-89cd4ae169b4 req-b55d0352-8297-4dfc-a554-610adf9b447e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029842 Jun 30 15:56:03.036590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 356/713] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:03.515626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:03.517055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:03.525930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.526486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.527336 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.527914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.532518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:03.533283 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:03.540784 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.541480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.542260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.543250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.561860 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:03.562494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:03.563015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'fault' on Instance uuid 2a57f154-45c7-46ac-9822-bedfd64be7a2 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:56:03.613326 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:03.621009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9a529dc9-7496-4ebb-804c-710379e63372 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 200 len: 1335 microversion: 2.1 time: 0.109653 Jun 30 15:56:03.621711 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 358/714] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:03 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:03.704679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:03.712532 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-696181b6-6429-492f-8073-eabd8c7d9e2a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1364 microversion: 2.1 time: 0.186694 Jun 30 15:56:03.713414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 357/715] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:03 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:04.639487 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:04.640352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 2a57f154-45c7-46ac-9822-bedfd64be7a2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:04.647449 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.647897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:04.648692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.649124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:04.664303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] HTTP exception thrown: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Request method failure captured: Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 HTTP/1.1 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZYVFSuUAxleG2k0a2OCamkz_RJtaY2Xq_DcljXOX2BcWa9SjeOxPb0obPYXgsefIxFkMfdwDV6nV6A8foadrrliK_obQfc2oAEj59w_Ahyk4C5lCCl3iEtB4l4C4Wagpi_bez67k_6QS6tcppzZISAD3XwBi0TxnHwznocqiCtYIs Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:56:04.666089 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01a8c235ed97450bb8518af9d7dc1983", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: d30ffdb0374c4600a09476cfb3a07cb4 Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. Jun 30 15:56:04.667750 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '2a57f154-45c7-46ac-9822-bedfd64be7a2'} Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:04.668827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. Jun 30 15:56:04.671083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:04.673137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Returning 404 to user: Instance 2a57f154-45c7-46ac-9822-bedfd64be7a2 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:04.673137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-18b3578e-99eb-44d6-b9a0-6de0f91acc57 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2" status: 404 len: 111 microversion: 2.1 time: 0.033940 Jun 30 15:56:04.673137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 359/716] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:04 2022] GET /compute/v2.1/servers/2a57f154-45c7-46ac-9822-bedfd64be7a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:56:04.678734 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-551e0b56-3cf4-42af-bf4f-2b36aadc2c78 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '.version_select at 0x7fbbda55ee50>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:04.699953 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-551e0b56-3cf4-42af-bf4f-2b36aadc2c78 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345713788" status: 202 len: 0 microversion: 2.1 time: 0.025041 Jun 30 15:56:04.700611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 358/717] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 15:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345713788 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:56:04.735674 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:04.736516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:04.742732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.743275 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:04.744291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.744823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:04.916522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:04.924810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ca2e94c4-3de1-4b97-8301-00bc051f2906 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1550 microversion: 2.1 time: 0.198589 Jun 30 15:56:04.925514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 360/718] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:04 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:04.942429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:04.942941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:04.950025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.951133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:04.952031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:04.952531 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:05.062506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5b305d50-6a79-4f82-860f-704171198234 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124353 Jun 30 15:56:05.063616 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 359/719] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:56:04 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:06.098862 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-f38e724a-b151-42f3-b776-5ac02c054a4c req-b757bb53-ac08-440b-a2cb-ab5410638e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b19b9d-b5ed-46a3-915f-282c65bf910b", "tag": "39a6c862-9e37-406e-98d9-a8a2ee9d4cd0"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:06.110751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f38e724a-b151-42f3-b776-5ac02c054a4c req-b757bb53-ac08-440b-a2cb-ab5410638e1d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:06.111459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f38e724a-b151-42f3-b776-5ac02c054a4c req-b757bb53-ac08-440b-a2cb-ab5410638e1d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:06.123821 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-f38e724a-b151-42f3-b776-5ac02c054a4c req-b757bb53-ac08-440b-a2cb-ab5410638e1d service nova] Creating event network-changed:39a6c862-9e37-406e-98d9-a8a2ee9d4cd0 for instance 40b19b9d-b5ed-46a3-915f-282c65bf910b on hv-cinder-79760 Jun 30 15:56:06.129097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-f38e724a-b151-42f3-b776-5ac02c054a4c req-b757bb53-ac08-440b-a2cb-ab5410638e1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 Jun 30 15:56:06.130059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 361/720] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:07.821785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:07.822297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:07.828677 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:07.829122 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:07.829874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:07.830298 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:07.859177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:56:07.941999 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3f6130a7-264d-4c6a-a01a-067c8271dab4 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 204 len: 0 microversion: 2.1 time: 0.123830 Jun 30 15:56:07.943260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 360/721] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:56:07 2022] DELETE /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:56:07.952515 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:07.953482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:07.960199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:07.960640 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:07.961417 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:07.961852 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:07.965855 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:08.360620 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:08.371942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-15ff232b-eb4e-4981-803a-8be2290f37e6 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1508 microversion: 2.1 time: 0.424293 Jun 30 15:56:08.372763 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 362/722] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:07 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:56:09.399336 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:09.400557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:09.409933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:09.410379 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:09.411143 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:09.411575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:09.552818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:09.564649 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2276bd7c-1490-408d-9ec8-39cf0e05b68a tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1508 microversion: 2.1 time: 0.172055 Jun 30 15:56:09.565461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 361/723] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:09 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:10.591015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:10.591846 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:10.604862 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:10.605596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:10.607091 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:10.607549 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:10.762728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:10.776524 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8aa7ec8c-c732-42f8-b532-aec90384f90b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1508 microversion: 2.1 time: 0.192078 Jun 30 15:56:10.777257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 363/724] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:10 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:11.800235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:11.800895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:11.807713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:11.808218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:11.808967 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:11.809402 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:12.017099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:12.031153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be81fe20-596e-4b2b-b8fd-584b85e3a377 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 200 len: 1508 microversion: 2.1 time: 0.237180 Jun 30 15:56:12.031773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 362/725] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:11 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:12.548241 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-81860e0c-7d34-4c4e-b65e-015f450d1504 req-b40b4fb2-c90a-4207-b923-ce9239e230f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0650698c-ce72-4d65-bb06-23af0543521a", "name": "network-vif-deleted", "tag": "b419bf3d-cf4e-43db-962c-8fe5a23deadb"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:12.556444 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-81860e0c-7d34-4c4e-b65e-015f450d1504 req-b40b4fb2-c90a-4207-b923-ce9239e230f9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:12.556883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-81860e0c-7d34-4c4e-b65e-015f450d1504 req-b40b4fb2-c90a-4207-b923-ce9239e230f9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:12.567529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-81860e0c-7d34-4c4e-b65e-015f450d1504 req-b40b4fb2-c90a-4207-b923-ce9239e230f9 service nova] Creating event network-vif-deleted:b419bf3d-cf4e-43db-962c-8fe5a23deadb for instance 0650698c-ce72-4d65-bb06-23af0543521a on hv-cinder-79760 Jun 30 15:56:12.572563 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-81860e0c-7d34-4c4e-b65e-015f450d1504 req-b40b4fb2-c90a-4207-b923-ce9239e230f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172025 Jun 30 15:56:12.573132 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 364/726] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:13.048703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:13.050012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 0650698c-ce72-4d65-bb06-23af0543521a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:13.056640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.057109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.057940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.058372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.072176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] HTTP exception thrown: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Request method failure captured: Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a HTTP/1.1 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYVFSuUAxleG2k0a2OCamkz_RJtaY2Xq_DcljXOX2BcWa9SjeOxPb0obPYXgsefIxFkMfdwDV6nV6A8foadrrliK_obQfc2oAEj59w_Ahyk4C5lCCl3iEtB4l4C4Wagpi_bez67k_6QS6tcppzZISAD3XwBi0TxnHwznocqiCtYIs Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:56:13.073795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01a8c235ed97450bb8518af9d7dc1983", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: d30ffdb0374c4600a09476cfb3a07cb4 Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. Jun 30 15:56:13.075422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '0650698c-ce72-4d65-bb06-23af0543521a'} Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:13.076679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. Jun 30 15:56:13.078156 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:13.080073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Returning 404 to user: Instance 0650698c-ce72-4d65-bb06-23af0543521a could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:13.080073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9084046d-1d8d-408d-b872-5736813e3d3b tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a" status: 404 len: 111 microversion: 2.1 time: 0.030567 Jun 30 15:56:13.080073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 363/727] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:13 2022] GET /compute/v2.1/servers/0650698c-ce72-4d65-bb06-23af0543521a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:56:13.084710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:13.085311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:13.091816 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.092294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.093083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.093490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.118283 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:56:13.199492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-567eb258-b658-40a3-ad18-8f1d76c0b66f tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 204 len: 0 microversion: 2.1 time: 0.118738 Jun 30 15:56:13.199951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 365/728] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:56:13 2022] DELETE /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:56:13.208207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:13.208811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:13.215145 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.215596 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.216400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:13.216831 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:13.365852 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:13.382895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-27ce7c78-f9e4-4c4b-89db-30785d74cda7 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.178660 Jun 30 15:56:13.383467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 364/729] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:13 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:14.400986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:14.401704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:14.408947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:14.409390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:14.410151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:14.410573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:14.551573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:14.561338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-10308039-ce49-420c-8d9d-34fef026ec9e tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.164260 Jun 30 15:56:14.562168 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 366/730] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:14 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:15.578830 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:15.579526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:15.588070 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:15.588548 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:15.589306 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:15.590634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:15.614899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:15.745067 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:15.752912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ba2f1891-f937-438c-8002-4fac6d8f95de tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.178316 Jun 30 15:56:15.762927 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 365/731] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:15 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:16.770436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:16.771056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:16.778794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:16.779751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:16.780881 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:16.781320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:16.948526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:16.961470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-3af509fb-8114-4134-91ef-7a2fec151f00 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1521 microversion: 2.1 time: 0.195067 Jun 30 15:56:16.962612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 367/732] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:16 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:17.631945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-61a6a883-79c9-4487-af7c-afeceda6be37 req-59ef26ce-dc5f-4ffc-850b-a8d04aedac30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4019fc09-23bd-4909-9804-4c685e180031", "name": "network-vif-deleted", "tag": "938d07f0-00dc-4473-ad00-fcf65c20baa9"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:17.641741 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-61a6a883-79c9-4487-af7c-afeceda6be37 req-59ef26ce-dc5f-4ffc-850b-a8d04aedac30 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:17.641976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-61a6a883-79c9-4487-af7c-afeceda6be37 req-59ef26ce-dc5f-4ffc-850b-a8d04aedac30 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:17.665171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-61a6a883-79c9-4487-af7c-afeceda6be37 req-59ef26ce-dc5f-4ffc-850b-a8d04aedac30 service nova] Creating event network-vif-deleted:938d07f0-00dc-4473-ad00-fcf65c20baa9 for instance 4019fc09-23bd-4909-9804-4c685e180031 on hv-cinder-79760 Jun 30 15:56:17.671004 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-61a6a883-79c9-4487-af7c-afeceda6be37 req-59ef26ce-dc5f-4ffc-850b-a8d04aedac30 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042834 Jun 30 15:56:17.672365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 366/733] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:17.980024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:17.980857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:17.988396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:17.989077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:17.989920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:17.990698 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:18.032961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:18.033671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:18.034472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lazy-loading 'fault' on Instance uuid 4019fc09-23bd-4909-9804-4c685e180031 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:56:18.082081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ffdb0374c4600a09476cfb3a07cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a8c235ed97450bb8518af9d7dc1983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:18.092549 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-39c541fd-fee4-4240-b8c4-179b8566dc40 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 200 len: 1312 microversion: 2.1 time: 0.117384 Jun 30 15:56:18.093255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 368/734] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:17 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:19.110241 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:19.111100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] [instance: 4019fc09-23bd-4909-9804-4c685e180031] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:19.118789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:19.120016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:19.121394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:19.122186 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:19.138796 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] HTTP exception thrown: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Request method failure captured: Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 HTTP/1.1 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYVFSuUAxleG2k0a2OCamkz_RJtaY2Xq_DcljXOX2BcWa9SjeOxPb0obPYXgsefIxFkMfdwDV6nV6A8foadrrliK_obQfc2oAEj59w_Ahyk4C5lCCl3iEtB4l4C4Wagpi_bez67k_6QS6tcppzZISAD3XwBi0TxnHwznocqiCtYIs Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:56:19.140720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_01a8c235ed97450bb8518af9d7dc1983", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/01a8c235ed97450bb8518af9d7dc1983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 01a8c235ed97450bb8518af9d7dc1983 Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602273406 Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: d30ffdb0374c4600a09476cfb3a07cb4 Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602273406-project Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. Jun 30 15:56:19.142369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '4019fc09-23bd-4909-9804-4c685e180031'} Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:19.143407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. Jun 30 15:56:19.146026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:19.149990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] Returning 404 to user: Instance 4019fc09-23bd-4909-9804-4c685e180031 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:19.151029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2330c3f5-8f30-4035-ac2f-c66ac08732b2 tempest-ServerRescueNegativeTestJSON-602273406 tempest-ServerRescueNegativeTestJSON-602273406-project] 10.222.0.50 "GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031" status: 404 len: 111 microversion: 2.1 time: 0.045029 Jun 30 15:56:19.151762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 367/735] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:19 2022] GET /compute/v2.1/servers/4019fc09-23bd-4909-9804-4c685e180031 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:56:22.604345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:22.605739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:22.631818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:22.632468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:22.635577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:22.637485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:22.760471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:56:22.952646 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ac411839-2982-4bb3-9d96-133494b2ab4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 204 len: 0 microversion: 2.1 time: 0.355311 Jun 30 15:56:22.959065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 369/736] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:56:22 2022] DELETE /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:56:22.969531 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:22.970163 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:22.991898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:22.994348 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:23.009091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:23.010225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:23.667064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:23.678385 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b1fb1423-efa2-47b9-a427-f3a15f8b6021 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1575 microversion: 2.1 time: 0.717860 Jun 30 15:56:23.680509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 368/737] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:22 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1575 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:24.706697 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:24.708190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:24.727032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:24.728153 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:24.729666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:24.730239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:25.029060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:25.039415 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-36777dd8-0afc-4627-a75e-4d70548d60fb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1575 microversion: 2.1 time: 0.346482 Jun 30 15:56:25.040023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 370/738] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:24 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1575 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:26.057445 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:26.058071 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:26.067642 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:26.068122 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:26.068903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:26.072976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:26.222528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:26.241032 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c29ac7e7-041f-4873-83c8-27f15fc65153 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 200 len: 1508 microversion: 2.1 time: 0.186469 Jun 30 15:56:26.252169 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 369/739] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:26 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:26.283951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-795aa88a-8a06-4799-9f3b-7384fcc73129 req-4c04ef6d-dcf4-45b8-95bc-b4b5f9cb979e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b17294c-3c9b-481a-b90b-36b12e5d2c5a", "name": "network-vif-deleted", "tag": "f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:26.297719 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:26.318055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-795aa88a-8a06-4799-9f3b-7384fcc73129 req-4c04ef6d-dcf4-45b8-95bc-b4b5f9cb979e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:26.318518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-795aa88a-8a06-4799-9f3b-7384fcc73129 req-4c04ef6d-dcf4-45b8-95bc-b4b5f9cb979e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:26.365900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-795aa88a-8a06-4799-9f3b-7384fcc73129 req-4c04ef6d-dcf4-45b8-95bc-b4b5f9cb979e service nova] Creating event network-vif-deleted:f5d7281b-8a2e-4c93-b4cf-864a74bfb8fa for instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a on hv-cinder-79760 Jun 30 15:56:26.371383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-795aa88a-8a06-4799-9f3b-7384fcc73129 req-4c04ef6d-dcf4-45b8-95bc-b4b5f9cb979e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091360 Jun 30 15:56:26.375200 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 371/740] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:27.263116 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:27.263812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:27.291390 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:27.292088 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:27.292656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:27.293077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:27.314375 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] HTTP exception thrown: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Request method failure captured: Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a HTTP/1.1 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbQt0zL5lXZW2DbuSy2IZnRjuRdhsJERDzrq80UPedd-AJJZLI-SJ77AMLMc38Ss-UsmHmn1h_RQ4dBCmKOihgLU5wkyoMp4rNAqvpUI9OFRWMzj-NzPUhpiksO1i8GRcujRfNc0L9wdYjf2VnJcxZdIZlSv-0hyYxNw7umFgn0BD8 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: affc1e688df04803bb823ccadf904c0a Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:56:27.318295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_affc1e688df04803bb823ccadf904c0a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-TestVolumeBootPattern-540202404 Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: affc1e688df04803bb823ccadf904c0a Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-TestVolumeBootPattern-540202404-project Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 2de768b55f9a495295113de2ce1279e5 Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-TestVolumeBootPattern-540202404-project Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 15:56:27.319982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '1b17294c-3c9b-481a-b90b-36b12e5d2c5a'} Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:27.320953 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 15:56:27.322409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:27.333045 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Returning 404 to user: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:27.334211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-92aadfbc-ab4a-467c-9011-241b51783c88 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 404 len: 111 microversion: 2.1 time: 0.076224 Jun 30 15:56:27.339670 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 372/741] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:27 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:56:27.522455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3c19cba3-3c77-448c-962e-cd8a4293bb49 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Action: 'create', calling method: .version_select at 0x7fbbda61cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-317335609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxAI4r7bPusg5POn+HvspQnwKbD6E6orkywxNzLnr43Pi7V9QWu+v5H7tsqp70lLFOJSVzgbk7D3e6E07XEVIdQhCmQnP0WVvGp/0abyWPiUb35e/v/TF1/yWMvoy8G7w=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:27.526619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:27.547550 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-3c19cba3-3c77-448c-962e-cd8a4293bb49 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Getting quotas for project 7b94cd4341d64c409783fecfa81763e1. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:56:27.553497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-3c19cba3-3c77-448c-962e-cd8a4293bb49 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Getting quotas for user 6e1730c8601c4334913b13e85e76e8d1 and project 7b94cd4341d64c409783fecfa81763e1. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:56:27.586410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3c19cba3-3c77-448c-962e-cd8a4293bb49 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.327931 Jun 30 15:56:27.592821 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 370/742] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:56:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:27.624189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1833297168", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457533439", "security_groups": [{"name": "tempest-secgroup-smoke-690202865"}], "block_device_mapping_v2": [{"uuid": "c8af0421-91ef-488a-8b25-5e48de50c3dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "33f28908-5ff2-4a8b-a553-d1f2fd3a4df7"}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:27.831151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] validate_networks() for [('33f28908-5ff2-4a8b-a553-d1f2fd3a4df7', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:56:28.322306 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:56:28.322888 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:56:28.323367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:56:28.323887 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:56:28.324561 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:56:28.335249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:28.335969 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:28.337190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:28.337826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:28.366094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:56:28.370754 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for user 2de768b55f9a495295113de2ce1279e5 and project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:56:28.468418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:56:28.472405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8af0421-91ef-488a-8b25-5e48de50c3dd',volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:56:28.747823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fdca4fcb-6404-4e86-b71b-e183953e73ee tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.127420 Jun 30 15:56:28.757688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 373/743] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:56:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:56:28.762948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c5c3b780-4004-4153-9c76-bc67883a0569 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:28.763554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c5c3b780-4004-4153-9c76-bc67883a0569 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:28.892970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c5c3b780-4004-4153-9c76-bc67883a0569 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:28.904055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c5c3b780-4004-4153-9c76-bc67883a0569 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1094 microversion: 2.1 time: 0.145419 Jun 30 15:56:28.908662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 371/744] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:28 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:29.925800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:29.926408 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:29.932897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:29.933253 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:29.934125 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:29.934556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:30.032907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:30.048525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c1c0830b-ee5a-4add-b591-a0758a4d4c1f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1192 microversion: 2.1 time: 0.127189 Jun 30 15:56:30.049374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 374/745] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:29 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:31.068401 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:31.068948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:31.076357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:31.077564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:31.078537 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:31.079260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:31.316886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:31.331906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-17a3051e-678c-40b0-9aa1-63824cd54386 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.269677 Jun 30 15:56:31.341541 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 372/746] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:31 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:31.726651 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-2fceac17-d2a5-4645-80f4-9a93a258b4c4 req-11377c5e-ade7-4c11-bcdc-371f9eb863b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd27b33a-1ad4-49eb-82cb-9d4902ea8e65", "tag": "d7dfc636-d3ea-4da0-b88f-321be177f4c0"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:31.744894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2fceac17-d2a5-4645-80f4-9a93a258b4c4 req-11377c5e-ade7-4c11-bcdc-371f9eb863b5 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:31.745336 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2fceac17-d2a5-4645-80f4-9a93a258b4c4 req-11377c5e-ade7-4c11-bcdc-371f9eb863b5 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:31.769194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-2fceac17-d2a5-4645-80f4-9a93a258b4c4 req-11377c5e-ade7-4c11-bcdc-371f9eb863b5 service nova] Creating event network-changed:d7dfc636-d3ea-4da0-b88f-321be177f4c0 for instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 on hv-cinder-79760 Jun 30 15:56:31.778295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-2fceac17-d2a5-4645-80f4-9a93a258b4c4 req-11377c5e-ade7-4c11-bcdc-371f9eb863b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056740 Jun 30 15:56:31.779082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 375/747] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:32.350111 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:32.350815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:32.364520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:32.368146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:32.369600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:32.370014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:32.607088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:32.633107 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7f008c12-8092-404a-8589-3ad6a6092a5b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.287844 Jun 30 15:56:32.640374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 373/748] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:32 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:33.657262 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:33.657913 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:33.665031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:33.665481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:33.666245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:33.666679 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:33.803392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:33.811624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c34d744b-a060-472c-90a8-7d745e96508e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.159142 Jun 30 15:56:33.812210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 376/749] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:33 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:34.834088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:34.835082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:34.846264 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:34.847224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:34.848428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:34.849139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:34.999601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:35.007254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-707a6582-1f38-4362-90f1-fb584d6544e0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.179826 Jun 30 15:56:35.007810 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 374/750] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:34 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:35.066699 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1765038875"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:35.067266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:35.073990 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:35.074450 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:35.075199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:35.075634 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:35.211294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.network.security_group_api [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Removing security group ab33bbd3-ad0a-4a38-898b-25e48b0f8540 from port 7f24ad84-6842-4154-bf9d-47151f73404e Jun 30 15:56:35.598761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4e20231b-803b-49cc-9561-3ba69be4c568 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action" status: 202 len: 0 microversion: 2.1 time: 0.536058 Jun 30 15:56:35.603775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 377/751] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:56:35 2022] POST /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:56:35.607452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-d4087a4a-dce1-4a32-b7ba-64be8c7eef55 req-935f3fce-1c98-4253-a3b5-904182cd40fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:35.648989 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d4087a4a-dce1-4a32-b7ba-64be8c7eef55 req-935f3fce-1c98-4253-a3b5-904182cd40fd service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:35.651191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d4087a4a-dce1-4a32-b7ba-64be8c7eef55 req-935f3fce-1c98-4253-a3b5-904182cd40fd service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:35.665400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-d4087a4a-dce1-4a32-b7ba-64be8c7eef55 req-935f3fce-1c98-4253-a3b5-904182cd40fd service nova] Creating event network-changed:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:56:35.671237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-d4087a4a-dce1-4a32-b7ba-64be8c7eef55 req-935f3fce-1c98-4253-a3b5-904182cd40fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067561 Jun 30 15:56:35.673102 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 375/752] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:56:36.025058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:36.026057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:36.034649 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:36.036486 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:36.037552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:36.040566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:36.302876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:36.307425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:36.312892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0f678875-0227-4bf2-843f-7e50e80ea553 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.292295 Jun 30 15:56:36.313474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 378/753] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:36 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:37.080951 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:37.081528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:37.096404 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.096965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.097719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.099838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.203755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lazy-loading 'services' on Instance uuid 3ec1f47c-9797-4e30-97da-74865fb275b2 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:56:37.239884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-51ae37e5-9377-4f79-8e3d-da138d776282 req-a67b6f2d-fb4c-400e-8e04-5e40842e101d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:37.251619 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-51ae37e5-9377-4f79-8e3d-da138d776282 req-a67b6f2d-fb4c-400e-8e04-5e40842e101d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.252580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-51ae37e5-9377-4f79-8e3d-da138d776282 req-a67b6f2d-fb4c-400e-8e04-5e40842e101d service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.276409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-51ae37e5-9377-4f79-8e3d-da138d776282 req-a67b6f2d-fb4c-400e-8e04-5e40842e101d service nova] Creating event network-changed:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:56:37.283373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-51ae37e5-9377-4f79-8e3d-da138d776282 req-a67b6f2d-fb4c-400e-8e04-5e40842e101d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200753 Jun 30 15:56:37.283978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 379/754] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:37.318280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e0618264-7567-4ff7-b69e-230de54c37a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments/d7cde753-5d12-41e4-abab-2a17392b7ca3" status: 202 len: 0 microversion: 2.1 time: 0.241863 Jun 30 15:56:37.318960 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 376/755] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:56:37 2022] DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments/d7cde753-5d12-41e4-abab-2a17392b7ca3 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:56:37.328017 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:37.329028 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:37.330600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:37.331464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:37.338016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.338454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.339450 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.339877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.360230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.361122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.362834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:37.363483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:37.396997 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fd7e2efc-0da5-4b6a-af83-2e29a9a351a0 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073087 Jun 30 15:56:37.401252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 380/756] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:56:37 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:37.581315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:37.591827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f4abf4e6-eb72-4f07-adea-d2dfd6e636d2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.265780 Jun 30 15:56:37.592447 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 377/757] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:37 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:56:38.406722 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:38.408441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:38.418507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:38.419441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:38.425884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.426637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.427409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.427837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.456557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-155a5c33-4e7a-449c-96ad-9a7ea476d1b6 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051190 Jun 30 15:56:38.457063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 381/758] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:56:38 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:38.609088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:38.609700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:38.616565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.617010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.617764 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.618197 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.779823 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:38.791964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9bdec85d-3ac2-4021-9c78-228729dc2319 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.186480 Jun 30 15:56:38.793033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 378/759] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:38 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:38.812308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:38.813038 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:38.820554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.821005 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.821850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:38.822419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:38.853330 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-da5e3228-f121-4577-aa89-5bc28b25bedc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/ips" status: 200 len: 151 microversion: 2.20 time: 0.045215 Jun 30 15:56:38.859201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 382/760] 10.222.0.50 () {60 vars in 1288 bytes} [Thu Jun 30 15:56:38 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:56:39.469589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:39.470661 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:39.472893 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:39.478823 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.479276 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.480992 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.481426 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.515405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-52364701-6415-45f6-b23f-c84bbfd2e2eb tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050761 Jun 30 15:56:39.516012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 379/761] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:56:39 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:56:39.526223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:39.527084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:39.535170 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.536017 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.537519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.538405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.630574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] HTTP exception thrown: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 is not attached to volume d7cde753-5d12-41e4-abab-2a17392b7ca3 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Request method failure captured: Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments/d7cde753-5d12-41e4-abab-2a17392b7ca3 HTTP/1.1 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbyRYO5pX_PFeRq3Khzz8k6ykX2GpUzcIZoL4jXKU6O2_su9x8fyWdPhS2LEKX1EeQzUSwTK0oQ6xcrVGQ1a_ZWwRSsP2F-2K0sPV47ABVBGIDQVHbSsOvV4pLSEk-4UDGuZbFUG9k1IA4qJOg8d1qemToJzIXKrsfSNmgAxo9FR2w Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: e1f6fecd9b364f3bbc6281bf3a2e8ade Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:56:39.633059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e1f6fecd9b364f3bbc6281bf3a2e8ade", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: e1f6fecd9b364f3bbc6281bf3a2e8ade Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-TestMinimumBasicScenario-391530844-project Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: b8203a321cce4c558a69ff6ca75a4d27 Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-TestMinimumBasicScenario-391530844-project Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:56:39.634633 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 is not attached to volume d7cde753-5d12-41e4-abab-2a17392b7ca3 Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'server_id': '3ec1f47c-9797-4e30-97da-74865fb275b2', 'id': 'd7cde753-5d12-41e4-abab-2a17392b7ca3'} Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7cde753-5d12-41e4-abab-2a17392b7ca3. Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:39.635463 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 is not attached to volume d7cde753-5d12-41e4-abab-2a17392b7ca3 Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 is not attached to volume d7cde753-5d12-41e4-abab-2a17392b7ca3 Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:56:39.636868 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Returning 404 to user: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 is not attached to volume d7cde753-5d12-41e4-abab-2a17392b7ca3 {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:39.639848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-68901f36-baeb-4bf8-bf18-b2e349a723cc tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments/d7cde753-5d12-41e4-abab-2a17392b7ca3" status: 404 len: 154 microversion: 2.1 time: 0.112752 Jun 30 15:56:39.639848 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 383/762] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:56:39 2022] DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2/os-volume_attachments/d7cde753-5d12-41e4-abab-2a17392b7ca3 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:56:39.810135 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:39.811318 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:39.820341 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.820911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.822114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:39.822957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:39.994309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:40.017618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cd14bc70-54b7-4526-85e2-267d4015ba45 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.212061 Jun 30 15:56:40.018431 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 380/763] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:39 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:40.799518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:40.800052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:40.807434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:40.808015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:40.808785 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:40.809214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:40.835475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:56:40.918516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-91a42790-f333-482f-b642-e0ed890b5694 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 204 len: 0 microversion: 2.1 time: 0.122583 Jun 30 15:56:40.919098 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 384/764] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:56:40 2022] DELETE /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:56:40.927346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:40.928740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:40.936022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:40.936604 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:40.937487 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:40.938400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.036849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:41.037590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:41.043739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.044266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.045579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.045579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.069938 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:41.077627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-75c18347-2c2c-41fe-9c48-a2ec37cf1a3d tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1553 microversion: 2.1 time: 0.154030 Jun 30 15:56:41.078407 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 381/765] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:40 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:41.194784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:41.202741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b1b593cb-fe02-4161-a9c3-7553ca83cbdd tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.170138 Jun 30 15:56:41.203310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 385/766] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:41 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:41.578194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:41.579037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:41.589964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.590420 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.591452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.591897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.616584 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lazy-loading 'flavor' on Instance uuid 68500daa-944e-4945-b9f7-af668da28e2c {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:56:41.882924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-55943ce8-aeab-4e3f-b736-6f489007f2a7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/action" status: 202 len: 0 microversion: 2.20 time: 0.309438 Jun 30 15:56:41.886497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 382/767] 10.222.0.50 () {62 vars in 1318 bytes} [Thu Jun 30 15:56:41 2022] POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:56:41.891732 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:41.892392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:41.899029 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.899516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.900385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.900815 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.975093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-e10834d9-630b-4a6b-84c8-ae236bd47726 req-1c6c8d95-b883-4c8e-ab8a-f9e3a055b664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd27b33a-1ad4-49eb-82cb-9d4902ea8e65", "name": "network-vif-plugged", "status": "completed", "tag": "d7dfc636-d3ea-4da0-b88f-321be177f4c0"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:41.985624 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e10834d9-630b-4a6b-84c8-ae236bd47726 req-1c6c8d95-b883-4c8e-ab8a-f9e3a055b664 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:41.986063 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e10834d9-630b-4a6b-84c8-ae236bd47726 req-1c6c8d95-b883-4c8e-ab8a-f9e3a055b664 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:41.997064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-e10834d9-630b-4a6b-84c8-ae236bd47726 req-1c6c8d95-b883-4c8e-ab8a-f9e3a055b664 service nova] Creating event network-vif-plugged:d7dfc636-d3ea-4da0-b88f-321be177f4c0 for instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 on hv-cinder-79760 Jun 30 15:56:42.002100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-e10834d9-630b-4a6b-84c8-ae236bd47726 req-1c6c8d95-b883-4c8e-ab8a-f9e3a055b664 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095346 Jun 30 15:56:42.002550 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 383/768] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:56:42.054510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:42.063550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:42.065081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:42.066248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-663bf3e6-ad03-4d19-a8de-d17aa4d016c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.178467 Jun 30 15:56:42.066799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 386/769] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:41 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:42.100267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:42.101087 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:42.107746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:42.108213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:42.108990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:42.109415 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:42.113429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:42.219563 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:42.220180 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:42.227266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:42.227723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:42.228525 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:42.228961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:42.250875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:42.258610 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2b484a20-99f2-4aad-8db1-b4842a577297 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1553 microversion: 2.1 time: 0.165030 Jun 30 15:56:42.259198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 384/770] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:42 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:42.369869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:42.377720 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d4acf6a8-7476-4264-841b-4813eb18257e tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.162335 Jun 30 15:56:42.378273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 387/771] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:42 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:43.091325 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:43.091957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:43.099039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.099490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.100297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.100765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.236133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:43.244879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:43.246421 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:43.247581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2bffa74c-e30a-4c89-87af-75b4d3fc0c62 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.160259 Jun 30 15:56:43.248164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 385/772] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:43 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:56:43.275757 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:43.276405 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:43.283448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.284052 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.284892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.285327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.394615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:43.395248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:43.401364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.401811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.402576 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:43.402992 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:43.415725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:43.428894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a17b7d4d-6ae0-40dd-bc37-6f1fae6f499e tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1553 microversion: 2.1 time: 0.156859 Jun 30 15:56:43.433377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 388/773] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:43 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:43.700134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:43.709956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-dc4e1ce3-e5da-403d-b644-051da4194440 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.319175 Jun 30 15:56:43.710541 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 386/774] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:43 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:56:44.048323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-fd77b053-b5a9-4505-a79a-200b7fafac00 req-cc15d24f-a30f-4457-9388-3a47919f3a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec1f47c-9797-4e30-97da-74865fb275b2", "name": "network-vif-deleted", "tag": "7f24ad84-6842-4154-bf9d-47151f73404e"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:44.060317 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-fd77b053-b5a9-4505-a79a-200b7fafac00 req-cc15d24f-a30f-4457-9388-3a47919f3a62 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.060760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-fd77b053-b5a9-4505-a79a-200b7fafac00 req-cc15d24f-a30f-4457-9388-3a47919f3a62 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.072201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-fd77b053-b5a9-4505-a79a-200b7fafac00 req-cc15d24f-a30f-4457-9388-3a47919f3a62 service nova] Creating event network-vif-deleted:7f24ad84-6842-4154-bf9d-47151f73404e for instance 3ec1f47c-9797-4e30-97da-74865fb275b2 on hv-cinder-79760 Jun 30 15:56:44.077184 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-fd77b053-b5a9-4505-a79a-200b7fafac00 req-cc15d24f-a30f-4457-9388-3a47919f3a62 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033817 Jun 30 15:56:44.077736 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 389/775] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:44.271099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:44.271925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:44.282890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.283637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.284955 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.285670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.430248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:44.438963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:44.440565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:44.441728 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-634bab5e-17ad-4c2f-8afc-5027a2121bd4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.177465 Jun 30 15:56:44.442318 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 387/776] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:44 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:44.450423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:44.451210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:44.457949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.458501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.459446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.460216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.493670 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.494160 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.494615 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lazy-loading 'fault' on Instance uuid 3ec1f47c-9797-4e30-97da-74865fb275b2 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:56:44.537410 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8203a321cce4c558a69ff6ca75a4d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f6fecd9b364f3bbc6281bf3a2e8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:44.545057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c37ef606-6f67-4604-8024-01970213c993 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 200 len: 1348 microversion: 2.1 time: 0.099434 Jun 30 15:56:44.545618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 390/777] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:44 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:44.731150 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:44.732205 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:44.742151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.742603 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.743368 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:44.743837 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:44.883167 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:44.891353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cfe0f00b-fe4e-42f0-aa46-e5d8412c2792 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1265 microversion: 2.1 time: 0.167012 Jun 30 15:56:44.891929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 388/778] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:44 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:45.462022 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:45.462636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:45.469386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.469935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:45.470699 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.471146 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:45.562530 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:45.563422 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] [instance: 3ec1f47c-9797-4e30-97da-74865fb275b2] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:45.570737 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.571429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:45.572221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.572741 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:45.595012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] HTTP exception thrown: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Request method failure captured: Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 HTTP/1.1 Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcbyRYO5pX_PFeRq3Khzz8k6ykX2GpUzcIZoL4jXKU6O2_su9x8fyWdPhS2LEKX1EeQzUSwTK0oQ6xcrVGQ1a_ZWwRSsP2F-2K0sPV47ABVBGIDQVHbSsOvV4pLSEk-4UDGuZbFUG9k1IA4qJOg8d1qemToJzIXKrsfSNmgAxo9FR2w Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: e1f6fecd9b364f3bbc6281bf3a2e8ade Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:56:45.596795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e1f6fecd9b364f3bbc6281bf3a2e8ade", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1f6fecd9b364f3bbc6281bf3a2e8ade"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: e1f6fecd9b364f3bbc6281bf3a2e8ade Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-TestMinimumBasicScenario-391530844 Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-TestMinimumBasicScenario-391530844-project Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: b8203a321cce4c558a69ff6ca75a4d27 Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-TestMinimumBasicScenario-391530844-project Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. Jun 30 15:56:45.598448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '3ec1f47c-9797-4e30-97da-74865fb275b2'} Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:56:45.599297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. Jun 30 15:56:45.600856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:56:45.602622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Returning 404 to user: Instance 3ec1f47c-9797-4e30-97da-74865fb275b2 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:56:45.602622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2b8a574d-ca32-4e62-80f4-b3f454fc111b tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2" status: 404 len: 111 microversion: 2.1 time: 0.039956 Jun 30 15:56:45.602622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 389/779] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:45 2022] GET /compute/v2.1/servers/3ec1f47c-9797-4e30-97da-74865fb275b2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 15:56:45.607651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-eea02a18-d36f-4a4e-a608-a95f54745262 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] Calling method '.version_select at 0x7fbbda5f35e0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:45.622297 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:45.628637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-eea02a18-d36f-4a4e-a608-a95f54745262 tempest-TestMinimumBasicScenario-391530844 tempest-TestMinimumBasicScenario-391530844-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-138450744" status: 202 len: 0 microversion: 2.1 time: 0.024728 Jun 30 15:56:45.629220 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 390/780] 10.222.0.50 () {58 vars in 1268 bytes} [Thu Jun 30 15:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-138450744 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 15:56:45.631512 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:45.633434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:45.635236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d8b59847-28e4-4eed-bf3f-4add9c1bceb6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.178361 Jun 30 15:56:45.635578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 391/781] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:45 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:45.908264 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:45.909036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:45.915315 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.915847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:45.916698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:45.917157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:46.057765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:46.066082 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6137a104-adb7-493a-9fa7-0cba0f5474d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1452 microversion: 2.1 time: 0.161974 Jun 30 15:56:46.066656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 391/782] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:45 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:46.082758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:46.083412 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:46.089869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:46.090554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:46.091436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:46.091871 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:46.227100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:46.234770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b5638eb6-7736-4981-a237-966b9b330d4b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1452 microversion: 2.1 time: 0.156091 Jun 30 15:56:46.235448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 392/783] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:46 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:46.654471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:46.656216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:46.666431 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:46.667258 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:46.668161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:46.668601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:47.247492 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:47.257471 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:47.259594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:47.260931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9b87fc34-aa49-48ef-8896-6fb2bf5219fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.611851 Jun 30 15:56:47.261474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 392/784] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:46 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:48.110887 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-9edc87f5-62ca-4d9f-a768-dca6ad05d1e1 req-7f63e52b-ff9a-4352-8bc2-8beb42c49ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd27b33a-1ad4-49eb-82cb-9d4902ea8e65", "tag": "d7dfc636-d3ea-4da0-b88f-321be177f4c0"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:48.125704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-9edc87f5-62ca-4d9f-a768-dca6ad05d1e1 req-7f63e52b-ff9a-4352-8bc2-8beb42c49ef9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:48.126426 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-9edc87f5-62ca-4d9f-a768-dca6ad05d1e1 req-7f63e52b-ff9a-4352-8bc2-8beb42c49ef9 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:48.143895 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-9edc87f5-62ca-4d9f-a768-dca6ad05d1e1 req-7f63e52b-ff9a-4352-8bc2-8beb42c49ef9 service nova] Creating event network-changed:d7dfc636-d3ea-4da0-b88f-321be177f4c0 for instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 on hv-cinder-79760 Jun 30 15:56:48.155936 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-9edc87f5-62ca-4d9f-a768-dca6ad05d1e1 req-7f63e52b-ff9a-4352-8bc2-8beb42c49ef9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050392 Jun 30 15:56:48.157321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 393/785] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:48.279233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:48.280499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:48.287615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:48.288856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:48.290112 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:48.290699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:48.489489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:48.504553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:48.506396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:48.508020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-59763988-911f-4d1b-8bef-7f12492c06a6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.233108 Jun 30 15:56:48.509325 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 393/786] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:48 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:48.929628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1862789211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-317335609", "security_groups": [{"name": "tempest-secgroup-smoke-1141443543"}], "networks": [{"uuid": "2568a903-6c1b-4766-b6f4-19b06ddf8d72"}], "block_device_mapping_v2": [{"uuid": "a4ce3e97-188f-443c-96de-1a594108fd47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:49.161041 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] validate_networks() for [('2568a903-6c1b-4766-b6f4-19b06ddf8d72', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:56:49.528038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:49.528560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:49.545270 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:49.551769 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:49.554674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:49.556886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:50.298614 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:50.314703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:50.316528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:50.317663 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f08d7bbe-a1b6-4294-add6-bb80fc607ffc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.795030 Jun 30 15:56:50.318200 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 394/787] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:49 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:56:50.337858 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:56:50.338399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:56:50.338926 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:56:50.339286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:56:50.340767 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:56:50.358901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:50.359519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:50.360618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:50.361285 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:50.387308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Getting quotas for project 7b94cd4341d64c409783fecfa81763e1. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:56:50.392078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Getting quotas for user 6e1730c8601c4334913b13e85e76e8d1 and project 7b94cd4341d64c409783fecfa81763e1. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:56:50.473879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:56:50.476469 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4ce3e97-188f-443c-96de-1a594108fd47',volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:56:50.622458 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f42e067f-d178-47e5-b769-df8e95bb7eb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.697794 Jun 30 15:56:50.623626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 394/788] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:56:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:56:50.633760 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1c09c7dd-ac63-4112-a64a-10be74fe1256 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:50.634364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1c09c7dd-ac63-4112-a64a-10be74fe1256 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:50.722667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1c09c7dd-ac63-4112-a64a-10be74fe1256 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:50.731271 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1c09c7dd-ac63-4112-a64a-10be74fe1256 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1088 microversion: 2.1 time: 0.101821 Jun 30 15:56:50.731846 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 395/789] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:50 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:51.335956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:51.337298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:51.345892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:51.347561 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:51.348705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:51.349865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:51.500753 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:51.509158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:51.510668 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:51.511837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2256065e-5101-438d-af8c-b040c469b2e0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.180698 Jun 30 15:56:51.512438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 395/790] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:51 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:56:51.747926 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:51.748562 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:51.756216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:51.756897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:51.757838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:51.758425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:51.854080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:51.864177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-dfbdc562-6d3e-4e2c-8d04-b14f32b679ef tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1194 microversion: 2.1 time: 0.120326 Jun 30 15:56:51.864940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 396/791] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:51 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1194 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:56:52.529941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:52.530550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:52.539270 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:52.539721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:52.540522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:52.540951 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:52.560890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:52.867108 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:52.876310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:52.878949 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:52.880570 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0c912864-ff1d-4d5a-9601-266fb59296d4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.354510 Jun 30 15:56:52.891237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 396/792] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:52 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:52.891454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:52.891454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:52.891454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:52.893715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:52.893715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:52.893715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:52.997777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:53.006273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b863a8ec-6c96-4639-9843-d1854710e992 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1192 microversion: 2.1 time: 0.128153 Jun 30 15:56:53.006845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 397/793] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:52 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:53.042637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:53.043661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:53.050237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:53.050689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:53.051456 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:53.051891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:53.074795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-992d8f03-5304-4f16-b83b-5ccb87a167f8 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/ips" status: 200 len: 145 microversion: 2.1 time: 0.037809 Jun 30 15:56:53.075371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 397/794] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 15:56:53 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:53.898886 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:53.900165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:53.907802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:53.908657 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:53.910774 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:53.911433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:54.023165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:54.023772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:54.031191 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:54.031834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:54.032714 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:54.033369 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:54.526725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:54.533139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:54.559935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-35dff770-4a30-4614-beef-dbdfd10fd2ed tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.540402 Jun 30 15:56:54.569242 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:54.570773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:54.571321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 398/795] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:54 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:56:54.571956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8f8229a4-2928-455c-acf2-c98e6e5e6fea tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1744 microversion: 2.20 time: 0.677211 Jun 30 15:56:54.573781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 398/796] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:53 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1744 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:54.577632 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5e63097-34fc-475f-98e4-b175a0ae66b6"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:54.583523 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:54.590534 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:54.591279 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:54.592291 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:54.592671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:54.871725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0e78cdb6-f234-400f-8d90-7336575677db tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298064 Jun 30 15:56:54.872497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 399/797] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:56:54 2022] POST /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:55.080726 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-1f3af33e-ab03-43c5-ada4-9ac06842714b req-988c0510-ea8b-43a1-8f24-0ab240110886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:55.109508 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1f3af33e-ab03-43c5-ada4-9ac06842714b req-988c0510-ea8b-43a1-8f24-0ab240110886 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:55.111073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1f3af33e-ab03-43c5-ada4-9ac06842714b req-988c0510-ea8b-43a1-8f24-0ab240110886 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:55.145206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-1f3af33e-ab03-43c5-ada4-9ac06842714b req-988c0510-ea8b-43a1-8f24-0ab240110886 service nova] Creating event network-changed:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 15:56:55.168986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-1f3af33e-ab03-43c5-ada4-9ac06842714b req-988c0510-ea8b-43a1-8f24-0ab240110886 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088510 Jun 30 15:56:55.171331 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 399/798] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:56:55.582032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:55.584078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:55.592791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:55.593501 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:55.597092 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:55.598643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:55.600050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:55.601438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:55.606645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:55.608382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:55.608382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:55.608586 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:55.973079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:56.004676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:56.016454 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:56.022780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:56.023526 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-24697f9d-5b7e-46d1-bac3-bf0e10745278 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.444194 Jun 30 15:56:56.024811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 400/799] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:55 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:56.025797 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a36699d1-d75c-49c3-b21e-4368e20d613f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1744 microversion: 2.20 time: 0.438556 Jun 30 15:56:56.026808 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 400/800] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:55 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1744 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:56.049505 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-7a429f70-0c5a-40ea-ac28-158b5fd480e0 req-45197a58-caa2-442b-a947-a0da029cd040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:56:56.057662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:56.072085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-7a429f70-0c5a-40ea-ac28-158b5fd480e0 req-45197a58-caa2-442b-a947-a0da029cd040 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:56.072715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-7a429f70-0c5a-40ea-ac28-158b5fd480e0 req-45197a58-caa2-442b-a947-a0da029cd040 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:56.086705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-7a429f70-0c5a-40ea-ac28-158b5fd480e0 req-45197a58-caa2-442b-a947-a0da029cd040 service nova] Creating event network-vif-plugged:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:56:56.092032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-7a429f70-0c5a-40ea-ac28-158b5fd480e0 req-45197a58-caa2-442b-a947-a0da029cd040 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064827 Jun 30 15:56:56.092544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 401/801] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:56:57.051030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:57.052728 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:57.053789 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:57.063051 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:57.092026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:57.092519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:57.099328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:57.101521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:57.102645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:57.103106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:57.108255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:57.110573 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:57.506198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:57.511941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:57.517191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-146fe3e0-26dd-4273-b3e7-7d2d63dbc3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.478763 Jun 30 15:56:57.522832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:57.524705 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:57.527685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fe4d0497-dc89-44c9-9f76-5c2156257856 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.487386 Jun 30 15:56:57.529078 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 402/802] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:57 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:56:57.538139 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 401/803] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:57 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:58.534798 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:58.535428 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:58.542590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:58.543365 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:58.544154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:58.545249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:58.550420 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:58.551119 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:58.553611 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:56:58.579880 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:58.580365 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:58.581144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:58.581577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:58.831468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:58.843786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-10e2df7b-0d89-4b3b-9db7-e7a96ebc4658 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.312818 Jun 30 15:56:58.845058 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 403/804] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:58 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:56:58.891637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:58.908429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:58.909938 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:56:58.911128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-24b443b9-e2fd-49e7-93b1-5dc137cc868f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.364905 Jun 30 15:56:58.916147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 402/805] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:58 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:56:59.867165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:59.868495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:59.884331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:59.884777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:59.896254 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:59.896798 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:59.933016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:56:59.934982 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:56:59.950342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:59.956461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:56:59.959921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:56:59.959921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:00.168535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:00.185444 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fec50ed1-18d2-4187-850a-849ca5e15147 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.325017 Jun 30 15:57:00.186142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 404/806] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:56:59 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:00.220325 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:00.231199 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:00.233343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:00.234807 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d6ea4a4c-e212-4a6a-a4cd-6b3661ec31fb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.308031 Jun 30 15:57:00.235636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 403/807] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:56:59 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:01.202319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:01.203203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:01.205561 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:01.206470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:01.214166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:01.214626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:01.215406 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:01.215843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:01.255259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:01.255259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:01.256474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:01.277147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:01.277679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:01.281357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:01.282252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:01.288976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:01.466256 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:01.490597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-21bea9ff-690f-4a04-9488-c5397a367a2b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.292388 Jun 30 15:57:01.491192 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 405/808] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:01 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:01.513196 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:01.521785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:01.523694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:01.525719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-45462f0d-8e57-42cd-aa53-1a4a698b7dcb tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.277096 Jun 30 15:57:01.526815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 404/809] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:01 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:57:02.512677 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:02.514201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:02.521647 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:02.522003 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:02.522764 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:02.523185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:02.547843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:02.548509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:02.559411 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:02.560194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:02.561488 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:02.562148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:03.153094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:03.159909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:03.166226 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b6781d35-2e0c-41fc-9cc3-43b183d09566 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.660569 Jun 30 15:57:03.169325 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:03.171047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:03.172399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-da2f16fb-ac37-4800-a115-9588c60b65c9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.628547 Jun 30 15:57:03.173404 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 405/810] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:02 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:03.178165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 406/811] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:02 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:03.182299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:03.183353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:03.190560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:03.191012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:03.191785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:03.192290 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:03.226295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-82413720-9b5e-4c97-a3a8-348c8441c378 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051299 Jun 30 15:57:03.232959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 406/812] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:57:03 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:03.244586 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:03.248090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:03.254831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:03.255398 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:03.256352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:03.256857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:03.302928 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-08bd6e7b-ad96-4f35-b898-3a9d58c44188 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6" status: 200 len: 194 microversion: 2.1 time: 0.068320 Jun 30 15:57:03.303680 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 407/813] 10.222.0.50 () {58 vars in 1412 bytes} [Thu Jun 30 15:57:03 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:04.185290 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:04.186588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:04.193677 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.194262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:04.195137 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.195421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:04.195856 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:04.196062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:04.207534 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.208172 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:04.219403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.219982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:04.467036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:04.472297 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:04.475133 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6c01c8ff-a8d5-4622-90a4-7822c3e092a1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.293551 Jun 30 15:57:04.476970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 407/814] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:04 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:04.485490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:04.488077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:04.489621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d342cd5f-5b4f-4225-858d-887276af5e6d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.298501 Jun 30 15:57:04.490202 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 408/815] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:04 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:57:04.715081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d26d8a9-5b37-4340-9845-e330e516c262"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:04.716178 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:04.722302 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.723185 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:04.724171 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:04.725042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:05.077047 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a6711a47-44de-4ffe-a40f-89be51b31510 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "POST /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366436 Jun 30 15:57:05.078151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 408/816] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:57:04 2022] POST /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:05.493373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:05.494667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:05.502031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:05.503420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:05.504987 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:05.507002 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:05.508577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:05.510167 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:05.518209 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:05.519069 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:05.520009 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:05.520589 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:05.750495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:05.760545 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-8d610434-4679-4758-bf5f-4ba73bcf95e1 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.270963 Jun 30 15:57:05.773569 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:05.778984 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 409/817] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:05 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:05.784962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:05.787393 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:05.789085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-073d1ea1-9ea2-4400-bbff-c97da616cc09 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.285786 Jun 30 15:57:05.799656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 409/818] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:05 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:57:06.033350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-b7b30885-d44d-46ee-b4d5-08a9a226035c req-da91d362-086d-450f-bd6d-11925def94c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "name": "network-vif-plugged", "status": "completed", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:06.042267 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b7b30885-d44d-46ee-b4d5-08a9a226035c req-da91d362-086d-450f-bd6d-11925def94c3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:06.042663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b7b30885-d44d-46ee-b4d5-08a9a226035c req-da91d362-086d-450f-bd6d-11925def94c3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:06.057260 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-b7b30885-d44d-46ee-b4d5-08a9a226035c req-da91d362-086d-450f-bd6d-11925def94c3 service nova] Creating event network-vif-plugged:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 15:57:06.063556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-b7b30885-d44d-46ee-b4d5-08a9a226035c req-da91d362-086d-450f-bd6d-11925def94c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Jun 30 15:57:06.065024 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 410/819] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:06.778401 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:06.779027 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:06.786628 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:06.787570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:06.788905 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:06.789507 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:06.809969 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:06.813417 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:06.825301 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:06.826663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:06.829254 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:06.830267 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:07.031792 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:07.043025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b1de4f5f-7e75-4ff9-8a5a-8d9d2f8f8408 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.268901 Jun 30 15:57:07.043601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 410/820] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:06 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:07.057403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:07.065697 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:07.067199 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:07.068474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cb716f44-fc18-43bd-a47b-54660c0a2d7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1739 microversion: 2.20 time: 0.264664 Jun 30 15:57:07.069036 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 411/821] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:06 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:08.064019 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:08.065081 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:08.074134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:08.075066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:08.076481 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:08.077503 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:08.090794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:08.092643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:08.123938 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:08.124323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:08.125090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:08.125519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:08.320566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:08.333189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-28bc24cc-8fa5-4665-a0bf-e20c1e5d0b0b tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1260 microversion: 2.1 time: 0.275673 Jun 30 15:57:08.334466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 411/822] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:08 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:08.335875 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:08.344465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:08.346151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:08.347708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f9e327fe-9750-4f72-8d91-32cbbfb16a6b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1721 microversion: 2.20 time: 0.262669 Jun 30 15:57:08.348289 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 412/823] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:08 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:09.351483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:09.352064 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:09.359075 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.359524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.361051 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.361491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.366427 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:09.367044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:09.374001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.374450 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.375232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.375680 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.398491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:09.569193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:09.572834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:09.578099 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d99946e2-cd4a-4469-8a9c-8923d1dafdbb tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1445 microversion: 2.1 time: 0.230868 Jun 30 15:57:09.578641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 412/824] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:09 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1445 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:09.580445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:09.582180 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:09.583322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c46f0d2f-89fb-40b2-9507-5bc876ecca15 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1721 microversion: 2.20 time: 0.220844 Jun 30 15:57:09.583884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 413/825] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:09 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:09.599235 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:09.599847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:09.606679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.607048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.607802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:09.608275 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:09.758838 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:09.767506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d9aeaf1b-7719-46cd-93c3-95e139064c9e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1445 microversion: 2.1 time: 0.172173 Jun 30 15:57:09.768085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 413/826] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:09 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:10.602102 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:10.602768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:10.610378 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:10.611315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:10.612350 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:10.612903 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:10.867127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:10.877590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:10.879044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:10.880255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-da24ecf2-9c63-4fa8-b92f-09be26e822b6 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1721 microversion: 2.20 time: 0.282439 Jun 30 15:57:10.882906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 414/827] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:10 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:11.653124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-2eaa9212-276f-4d6a-bb74-af80f1e87227 req-e4aff87d-70b4-440b-9a24-fcdd5d0409cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:11.663664 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-2eaa9212-276f-4d6a-bb74-af80f1e87227 req-e4aff87d-70b4-440b-9a24-fcdd5d0409cf service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:11.664147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-2eaa9212-276f-4d6a-bb74-af80f1e87227 req-e4aff87d-70b4-440b-9a24-fcdd5d0409cf service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:11.676767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-2eaa9212-276f-4d6a-bb74-af80f1e87227 req-e4aff87d-70b4-440b-9a24-fcdd5d0409cf service nova] Creating event network-changed:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 15:57:11.681817 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-2eaa9212-276f-4d6a-bb74-af80f1e87227 req-e4aff87d-70b4-440b-9a24-fcdd5d0409cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032469 Jun 30 15:57:11.682392 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 414/828] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:11.898676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:11.899305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:11.908578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:11.909008 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:11.909838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:11.910266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.050983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:12.059890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:12.060220 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-cb94a74c-3f96-49e4-adf8-84e101dcee7d req-a4b70543-dea5-492c-8173-6fb35c25f4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "name": "network-vif-unplugged", "status": "completed", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:12.061441 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:12.062618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7b5da421-0acd-4eae-85c0-f36f25e6cd2f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1724 microversion: 2.20 time: 0.167933 Jun 30 15:57:12.063704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 415/829] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:11 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:12.070008 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-cb94a74c-3f96-49e4-adf8-84e101dcee7d req-a4b70543-dea5-492c-8173-6fb35c25f4bc service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.070426 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-cb94a74c-3f96-49e4-adf8-84e101dcee7d req-a4b70543-dea5-492c-8173-6fb35c25f4bc service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.081349 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa663060-83d2-4e64-911a-0d0f5d851d5e"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:12.082020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-cb94a74c-3f96-49e4-adf8-84e101dcee7d req-a4b70543-dea5-492c-8173-6fb35c25f4bc service nova] Creating event network-vif-unplugged:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:57:12.083082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:12.086845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-cb94a74c-3f96-49e4-adf8-84e101dcee7d req-a4b70543-dea5-492c-8173-6fb35c25f4bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030824 Jun 30 15:57:12.087502 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 415/830] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:12.090872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.091327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.092166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.092801 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.412518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b0c1b958-19fc-4b7c-b575-85d1fb78dce9 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335772 Jun 30 15:57:12.413130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 416/831] 10.222.0.50 () {62 vars in 1363 bytes} [Thu Jun 30 15:57:12 2022] POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 15:57:12.547410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:12.549263 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:12.556199 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.556559 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.557328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.557765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.912645 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7f058074-aacf-4137-855c-756ac1559bdc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments/aa663060-83d2-4e64-911a-0d0f5d851d5e" status: 202 len: 0 microversion: 2.20 time: 0.368963 Jun 30 15:57:12.916437 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 416/832] 10.222.0.50 () {60 vars in 1456 bytes} [Thu Jun 30 15:57:12 2022] DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments/aa663060-83d2-4e64-911a-0d0f5d851d5e => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:57:12.991182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:12.991769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:12.998265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:12.998709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:12.999610 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.000073 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.082386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cbcfe88c-f2a9-4c0d-844f-7c4e44ed8d4c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/action" status: 202 len: 0 microversion: 2.20 time: 0.097836 Jun 30 15:57:13.082996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 417/833] 10.222.0.50 () {62 vars in 1318 bytes} [Thu Jun 30 15:57:12 2022] POST /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:57:13.091554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:13.092198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:13.098887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.099574 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.101147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.101797 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.280231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:13.289075 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:13.290616 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:13.291851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a5d3e98d-1642-498f-b8da-16235362a892 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1672 microversion: 2.20 time: 0.204576 Jun 30 15:57:13.296043 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 417/834] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:13 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:13.748874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:13.749923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:13.756094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.756548 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.757309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.757746 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.787614 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-65a7567e-f554-45d9-a19a-8a516bf7abe0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042841 Jun 30 15:57:13.788215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 418/835] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:57:13 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:57:13.944586 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:13.945895 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:13.953399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.954085 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.954857 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:13.955296 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:13.970605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:13.988556 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4257fcdf-5e86-4fe6-8b1d-ff22cc090462 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6" status: 200 len: 194 microversion: 2.1 time: 0.048227 Jun 30 15:57:13.989138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 418/836] 10.222.0.50 () {58 vars in 1412 bytes} [Thu Jun 30 15:57:13 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:13.998786 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:13.999319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:14.006208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:14.006702 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:14.007467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:14.007906 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:14.097752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lazy-loading 'services' on Instance uuid 40b19b9d-b5ed-46a3-915f-282c65bf910b {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:57:14.177983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-fcc78f79-9ae2-4307-a1d2-ac47cb553995 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6" status: 202 len: 0 microversion: 2.1 time: 0.182889 Jun 30 15:57:14.178603 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 419/837] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:57:13 2022] DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/e5e63097-34fc-475f-98e4-b175a0ae66b6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 15:57:14.310809 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:14.311444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:14.318191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:14.318635 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:14.319386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:14.319811 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:14.453921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:14.466913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:14.469213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:14.471037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4d173a2e-c079-4449-9f40-e8d98535c625 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.164169 Jun 30 15:57:14.471793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 419/838] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:14 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:15.492992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:15.493674 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:15.500745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:15.501158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:15.501908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:15.502334 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:15.728646 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:15.737566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:15.739183 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:15.740534 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bcc46829-d4b3-4e1d-a897-2f9669f00c26 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.251866 Jun 30 15:57:15.741083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 420/839] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:15 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:16.355862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:16.356394 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:16.363020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.363466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:16.364255 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.364688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:16.395448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-53be0f63-8783-4b37-8c9e-e47293b03a85 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/4d26d8a9-5b37-4340-9845-e330e516c262" status: 200 len: 194 microversion: 2.1 time: 0.043713 Jun 30 15:57:16.396510 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 420/840] 10.222.0.50 () {58 vars in 1412 bytes} [Thu Jun 30 15:57:16 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/4d26d8a9-5b37-4340-9845-e330e516c262 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:16.406176 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:16.406438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:16.414348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.415944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:16.416991 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.417576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:16.531491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lazy-loading 'services' on Instance uuid 40b19b9d-b5ed-46a3-915f-282c65bf910b {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:57:16.638769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ca2b3a47-bff3-4858-9064-2eb06aeece15 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/4d26d8a9-5b37-4340-9845-e330e516c262" status: 202 len: 0 microversion: 2.1 time: 0.236704 Jun 30 15:57:16.639608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 421/841] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 15:57:16 2022] DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments/4d26d8a9-5b37-4340-9845-e330e516c262 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:57:16.758928 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:16.760215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:16.768317 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.768968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:16.773439 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:16.773935 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:17.202633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:17.212506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:17.214003 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:17.215289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7b6f973d-8650-4809-b125-33ae04da3302 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.460504 Jun 30 15:57:17.215842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 421/842] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:16 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:18.235069 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:18.236230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:18.243513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:18.243956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:18.244958 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:18.245387 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:18.396460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:18.408967 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:18.410471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:18.411658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-685c8567-0a40-461a-82df-3f880c45b4fc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.182144 Jun 30 15:57:18.412265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 422/843] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:18 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:19.430594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:19.431203 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:19.438048 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:19.438500 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:19.439261 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:19.439693 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:19.583731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:19.592670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:19.594327 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:19.595567 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b78e9b6b-5f54-456c-ad4c-5517c95c44c5 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.168991 Jun 30 15:57:19.596236 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 422/844] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:19 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:20.614695 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:20.616193 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:20.623800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:20.624756 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:20.625877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:20.626402 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:20.814023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:20.822628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:20.824372 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:20.825550 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-78eba022-5930-4ec3-bfcb-e2b86a6d5c91 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.215295 Jun 30 15:57:20.836402 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 423/845] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:20 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:21.843668 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:21.844598 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:21.852354 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:21.853225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:21.854248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:21.854897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:22.066404 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:22.079655 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:22.081433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:22.082615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1d8c6488-0004-4f80-aa2e-1e758f16e04a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.243541 Jun 30 15:57:22.083176 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 423/846] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:21 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:23.101332 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:23.102197 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:23.109468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:23.109916 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:23.110691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:23.111123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:23.276195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:23.288219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:23.290859 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:23.292389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f9dfab31-8ba1-4ea5-bb9f-e6e73f7b5d72 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.196095 Jun 30 15:57:23.293995 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 424/847] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:23 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:57:24.310976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:24.311710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:24.318679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:24.319129 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:24.319890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:24.320353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:24.466854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:24.478311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:24.480615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:24.481766 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b787e866-dcb1-4830-91ca-4e8d0696f9d2 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.174838 Jun 30 15:57:24.482317 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 424/848] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:24 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:25.504341 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:25.505127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:25.515674 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:25.516349 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:25.517510 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:25.518165 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:25.524629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:25.665239 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:25.677513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:25.679874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:25.681637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-11c1a785-e938-46ad-b587-5986da0df70b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.183696 Jun 30 15:57:25.682478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 425/849] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:25 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:26.704583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:26.705642 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:26.716768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:26.717520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:26.718785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:26.719559 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:26.856441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:26.864688 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:26.866188 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:26.867351 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0ed93270-4c15-463b-a5c9-a1bfef5a6233 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.169475 Jun 30 15:57:26.867902 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 425/850] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:26 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:27.885696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:27.886385 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:27.888734 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=52 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:27.894830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:27.895274 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:27.896043 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:27.896470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:28.206204 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:28.214594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:28.216134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:28.217303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-304f43dd-4d19-453e-886a-12e785691c10 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.335660 Jun 30 15:57:28.217850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 426/851] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:27 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:29.234745 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:29.235363 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:29.237761 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=48 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:29.243137 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.243594 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.244391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.244862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.382472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:29.390647 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:29.392350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:29.393524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b5d9a6ef-3da4-4fe6-8430-8c816da34c23 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.162849 Jun 30 15:57:29.394075 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 426/852] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:29 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:29.518056 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:29.519040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:29.526130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.526580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.527339 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.527771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.557683 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-31804de0-d6eb-4002-ad89-d51ef37bccc0 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043558 Jun 30 15:57:29.558219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 427/853] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:57:29 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 15:57:29.667166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:29.668128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:29.674485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.674933 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.675691 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.676161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.705644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1edcdc14-1b23-4071-b3c0-25edf8cb51b4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042278 Jun 30 15:57:29.706104 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 427/854] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 15:57:29 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 15:57:29.769768 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:29.770288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:29.776894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.777389 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.778147 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.778594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.803482 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:57:29.888232 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-84be55fd-f911-4794-8a00-a589738415ea tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 204 len: 0 microversion: 2.1 time: 0.121893 Jun 30 15:57:29.889541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 428/855] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:57:29 2022] DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 15:57:29.899193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:29.899802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:29.906307 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.906755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:29.907515 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:29.907948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:30.042689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:30.054322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6e26fe0d-6c42-4b11-82c0-5f62ea9f3fbc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.158822 Jun 30 15:57:30.055142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 428/856] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:29 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:57:30.411419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:30.412137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:30.418375 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:30.418824 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:30.419618 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:30.420079 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:30.563592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:30.571924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:30.573458 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:30.574632 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-91309d44-af43-4de4-8892-518bc8be7084 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.167560 Jun 30 15:57:30.575223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 429/857] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:30 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:31.076173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:31.076824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:31.084078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:31.084528 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:31.085297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:31.085730 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:31.216173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:31.228312 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5142c367-29a4-4d33-80a0-2c4eb22e270b tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.158440 Jun 30 15:57:31.229071 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 429/858] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:31 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:31.598576 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:31.599540 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:31.606528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:31.607077 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:31.607873 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:31.608401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:31.745925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:31.758517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:31.760952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:31.762282 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-33620f82-3900-4bb7-8c3f-ac9e99f14ee0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.167656 Jun 30 15:57:31.763090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 430/859] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:31 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:32.250206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:32.250961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:32.259172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:32.259701 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:32.260656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:32.261168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:32.403089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:32.410957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-28f1036c-d96a-47f4-9d78-32ab4b9bbddc tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.166936 Jun 30 15:57:32.411513 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 430/860] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:32 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:32.781250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:32.781844 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:32.788640 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:32.789098 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:32.789935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:32.790361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:32.929992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:32.938105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:32.939602 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:32.940794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2811ed19-ceba-48a3-b0c7-699601fc19c7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.163541 Jun 30 15:57:32.941370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 431/861] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:32 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:33.432405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:33.433400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:33.444319 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:33.445053 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:33.446509 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:33.447221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:33.586226 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:33.606451 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-17ce85d3-c9ae-480e-a31e-5f3047823dcf tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.180843 Jun 30 15:57:33.607061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 431/862] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:33 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:33.963322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:33.964401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:33.975932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:33.976738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:33.977998 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:33.978717 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:34.111095 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:34.119182 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:34.120724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:34.121895 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cb4949c9-6148-4a40-ae2f-d266383088c4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.165184 Jun 30 15:57:34.122438 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 432/863] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:33 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:34.629497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:34.630338 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:34.641558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:34.642015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:34.642777 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:34.643221 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:34.782152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:34.790333 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-383710d9-05e5-4ed6-a2f7-8aa3917b9058 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.167556 Jun 30 15:57:34.790899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 432/864] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:34 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:34.912016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-b7873b3c-2c5d-41b9-a250-cd0ade5395b1 req-db81fca8-9df0-4722-9963-7239f2774399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:34.920930 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b7873b3c-2c5d-41b9-a250-cd0ade5395b1 req-db81fca8-9df0-4722-9963-7239f2774399 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:34.921440 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b7873b3c-2c5d-41b9-a250-cd0ade5395b1 req-db81fca8-9df0-4722-9963-7239f2774399 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:34.933327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-b7873b3c-2c5d-41b9-a250-cd0ade5395b1 req-db81fca8-9df0-4722-9963-7239f2774399 service nova] Creating event network-vif-plugged:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:57:34.938252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-b7873b3c-2c5d-41b9-a250-cd0ade5395b1 req-db81fca8-9df0-4722-9963-7239f2774399 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031045 Jun 30 15:57:34.938839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 433/865] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:57:35.142252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:35.143153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:35.152145 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:35.152706 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:35.153791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:35.154419 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:35.287497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:35.295700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:35.297238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:35.298428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b84b85e1-dd99-4926-9cd2-ef84cc3541b4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.161812 Jun 30 15:57:35.298986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 433/866] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:35 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:35.813421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:35.814185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:35.821826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:35.822322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:35.823265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:35.823826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:35.969123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:35.977751 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b681800b-52b8-4664-b0c1-55344f7cd864 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.171741 Jun 30 15:57:35.978320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 434/867] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:35 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:36.317170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:36.317756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:36.324713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:36.325177 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:36.325921 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:36.326351 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:36.455489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:36.464175 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:36.465677 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:36.466835 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0e5c984d-9d30-4cde-bb8e-8eac81acfcfc tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.153788 Jun 30 15:57:36.467395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 434/868] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:36 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:36.995325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:36.995937 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:37.002819 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:37.003259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:37.004023 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:37.004468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:37.136811 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:37.144468 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7617e679-3b77-4706-8a56-b5863ccdf970 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1674 microversion: 2.1 time: 0.153200 Jun 30 15:57:37.145026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 435/869] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:36 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:37.487061 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:37.487672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:37.495131 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:37.495575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:37.496388 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:37.496859 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:37.499547 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=100 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:57:37.731828 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:37.740400 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:37.741945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:37.743109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0ca8575a-55f5-4847-b96c-ab9d5db4ec43 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.260137 Jun 30 15:57:37.743674 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 435/870] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:37 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:38.131514 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-4159b9b0-0fee-4ecf-997d-104c8822a757 req-1376ed7c-3446-4931-8856-55fc1b3ca418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b19b9d-b5ed-46a3-915f-282c65bf910b", "name": "network-vif-deleted", "tag": "39a6c862-9e37-406e-98d9-a8a2ee9d4cd0"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:57:38.153019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4159b9b0-0fee-4ecf-997d-104c8822a757 req-1376ed7c-3446-4931-8856-55fc1b3ca418 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:38.165452 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:38.166084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:38.168491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4159b9b0-0fee-4ecf-997d-104c8822a757 req-1376ed7c-3446-4931-8856-55fc1b3ca418 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:38.179636 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:38.181597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-4159b9b0-0fee-4ecf-997d-104c8822a757 req-1376ed7c-3446-4931-8856-55fc1b3ca418 service nova] Creating event network-vif-deleted:39a6c862-9e37-406e-98d9-a8a2ee9d4cd0 for instance 40b19b9d-b5ed-46a3-915f-282c65bf910b on hv-cinder-79760 Jun 30 15:57:38.181730 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:38.183100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:38.186745 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-4159b9b0-0fee-4ecf-997d-104c8822a757 req-1376ed7c-3446-4931-8856-55fc1b3ca418 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059407 Jun 30 15:57:38.187660 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 436/871] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:57:38.188089 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:38.269898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c67a263b14158a01fd906a31696cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9874821533c3446c9d71a65fb5b8e703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:38.288286 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9bf0f169-9088-42c0-be91-8d33c3b9a326 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 200 len: 1606 microversion: 2.1 time: 0.129823 Jun 30 15:57:38.292352 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 436/872] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:38 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 1606 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:57:38.763475 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:38.764369 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:38.771236 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:38.771961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:38.772418 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:38.772847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:38.915151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:38.923619 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:38.925152 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:38.926539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5b648e25-777a-4d8d-aaed-1647b66704e4 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1730 microversion: 2.20 time: 0.168454 Jun 30 15:57:38.927087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 437/873] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:38 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:39.307505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:39.308279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:39.315371 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:39.315818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:39.316620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:39.317055 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:39.331260 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b HTTP/1.1 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:57:39.333079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:39.334713 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '40b19b9d-b5ed-46a3-915f-282c65bf910b'} Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:57:39.339194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:39.340780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:39.342168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:57:39.342168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-88d841d3-6a7d-4ee1-8c9c-39d25dd2bf6a tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 404 len: 111 microversion: 2.1 time: 0.030952 Jun 30 15:57:39.342168 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 437/874] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:39 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:57:39.347366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-343578e6-341d-4f10-a373-0307752054cd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '.version_select at 0x7fbbda6555e0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:39.368495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-343578e6-341d-4f10-a373-0307752054cd tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367321771" status: 202 len: 0 microversion: 2.1 time: 0.024809 Jun 30 15:57:39.369090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 438/875] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 15:57:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367321771 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:57:39.945842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:39.946818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:39.954373 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:39.954937 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:39.955928 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:39.956489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:40.253309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:40.261632 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:40.263184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:57:40.264377 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0a5cb31b-19e0-40d1-8ec6-bcc6268c9f8d tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1717 microversion: 2.20 time: 0.324113 Jun 30 15:57:40.265157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 438/876] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:57:39 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1717 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:57:42.594186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:42.594696 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:42.601409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:42.601863 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:42.602629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:42.603065 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:42.616851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b HTTP/1.1 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:57:42.618584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.620143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '40b19b9d-b5ed-46a3-915f-282c65bf910b'} Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:57:42.621039 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.622535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.624057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:57:42.624057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-532211e9-a421-4911-8ee8-a1861c797603 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jun 30 15:57:42.624057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 439/877] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:57:42 2022] DELETE /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:57:42.628675 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:42.629295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: 40b19b9d-b5ed-46a3-915f-282c65bf910b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:42.636266 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:42.636741 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:42.637506 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:42.637942 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:42.653396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b HTTP/1.1 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:57:42.654912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.656615 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '40b19b9d-b5ed-46a3-915f-282c65bf910b'} Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:57:42.657540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. Jun 30 15:57:42.659016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:42.660489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance 40b19b9d-b5ed-46a3-915f-282c65bf910b could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:57:42.660489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0b99985a-9f6c-475d-af65-bb1b7891d93f tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b" status: 404 len: 111 microversion: 2.1 time: 0.031538 Jun 30 15:57:42.660489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 439/878] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:42 2022] GET /compute/v2.1/servers/40b19b9d-b5ed-46a3-915f-282c65bf910b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:57:43.795778 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:43.796416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:43.803303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:43.803865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:43.804774 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:43.805464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:43.822111 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 HTTP/1.1 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:57:43.823738 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:43.825435 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'b85185f0-6858-4750-a044-9c3dc44d0240'} Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:57:43.826509 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:43.828044 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:57:43.829979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:57:43.829979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-adf4ad96-92d7-4719-8abe-f6d9c846a8ec tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 404 len: 111 microversion: 2.1 time: 0.033750 Jun 30 15:57:43.829979 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 440/879] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 15:57:43 2022] DELETE /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:57:43.835958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:57:43.836709 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] [instance: b85185f0-6858-4750-a044-9c3dc44d0240] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:57:43.843344 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:43.843896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:43.844725 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:57:43.845160 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:57:44.016912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] HTTP exception thrown: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Request method failure captured: Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 HTTP/1.1 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZPOZfM2RjlZjNzzQckIPx2t8VgDqs2m3v52IizcJ0ZaeAB23Qr-PJvQBOmF6cyvjQYZUBWwCgmZqnuvsgz8I39t5W6UFaXU_yw01gppS2X2LSacCfrDmVQEqFlOZOjgSk78pOmBIx8dvhPdojbDSbWU2yrbdbVOpflAynvLi9jO7o Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:57:44.018499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9874821533c3446c9d71a65fb5b8e703", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9874821533c3446c9d71a65fb5b8e703"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 9874821533c3446c9d71a65fb5b8e703 Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1612039656 Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2f3c67a263b14158a01fd906a31696cd Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeTestJSON-1612039656-project Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:44.020146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'b85185f0-6858-4750-a044-9c3dc44d0240'} Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:57:44.021172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. Jun 30 15:57:44.022633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:57:44.023762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] Returning 404 to user: Instance b85185f0-6858-4750-a044-9c3dc44d0240 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:57:44.023762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1bbcb82f-338e-4844-bbc9-75b80313efc4 tempest-AttachVolumeTestJSON-1612039656 tempest-AttachVolumeTestJSON-1612039656-project] 10.222.0.50 "GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240" status: 404 len: 111 microversion: 2.1 time: 0.189991 Jun 30 15:57:44.023762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 440/880] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:57:43 2022] GET /compute/v2.1/servers/b85185f0-6858-4750-a044-9c3dc44d0240 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 15:58:13.083813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:13.084767 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:13.087104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:13.087749 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:13.094671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.095124 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.095911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.096379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.127447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e8356b1d-905f-45d0-aaca-7eefbd8a9766 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047611 Jun 30 15:58:13.127964 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 441/881] 10.222.0.50 () {60 vars in 1342 bytes} [Thu Jun 30 15:58:13 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:13.185441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:13.185986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:13.188015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=29 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:13.188662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=23 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:13.195138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.195582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.196374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.196802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.231628 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 15:58:13.324178 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d878764e-a37f-462b-b0e7-04585ef20622 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 204 len: 0 microversion: 2.20 time: 0.142441 Jun 30 15:58:13.325049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 441/882] 10.222.0.50 () {60 vars in 1279 bytes} [Thu Jun 30 15:58:13 2022] DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 15:58:13.334286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:13.334904 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:13.341578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.342017 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.342789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:13.343373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:13.477515 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:13.485653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:13.487155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:13.488340 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1274536c-6b34-4fb7-84a9-a8cb009c2d7c tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.158936 Jun 30 15:58:13.488909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 442/883] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:13 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 15:58:14.511951 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:14.513384 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:14.523268 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:14.524312 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:14.525914 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:14.526842 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:14.691094 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:14.699519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:14.701093 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:14.702247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-848ca022-2d17-4f5b-aac8-ebc99965ee7a tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.197638 Jun 30 15:58:14.702794 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 442/884] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:14 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:58:15.725416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:15.726348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:15.738867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:15.739629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:15.740940 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:15.741658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:15.873575 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:15.882134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:15.883637 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:15.884837 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b3352c0a-43bf-44d1-8ac2-4e1695b7aea0 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1723 microversion: 2.20 time: 0.166430 Jun 30 15:58:15.885392 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 443/885] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:15 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:58:16.902875 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:16.903498 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:16.910206 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:16.910656 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:16.911423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:16.911855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:16.999776 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:17.008749 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:17.010213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f2f23e763704ce2b0969e24ffde9243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88ea20d31df42ec9e28d8f283aa15ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:17.011468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-56149baf-2a21-4066-93cb-8ff1b43164d7 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 200 len: 1655 microversion: 2.20 time: 0.112642 Jun 30 15:58:17.012027 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 443/886] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:16 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 15:58:17.295367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-b3c9efe4-31c3-4711-af55-00bf956ac502 req-e6835a58-b7b1-4b1d-9cd6-57bc8a38c754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68500daa-944e-4945-b9f7-af668da28e2c", "name": "network-vif-deleted", "tag": "1924d1b4-2071-468f-8b2e-e1954d5bd063"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:17.306430 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b3c9efe4-31c3-4711-af55-00bf956ac502 req-e6835a58-b7b1-4b1d-9cd6-57bc8a38c754 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:17.307194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-b3c9efe4-31c3-4711-af55-00bf956ac502 req-e6835a58-b7b1-4b1d-9cd6-57bc8a38c754 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:17.320172 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-b3c9efe4-31c3-4711-af55-00bf956ac502 req-e6835a58-b7b1-4b1d-9cd6-57bc8a38c754 service nova] Creating event network-vif-deleted:1924d1b4-2071-468f-8b2e-e1954d5bd063 for instance 68500daa-944e-4945-b9f7-af668da28e2c on hv-cinder-79760 Jun 30 15:58:17.325872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-b3c9efe4-31c3-4711-af55-00bf956ac502 req-e6835a58-b7b1-4b1d-9cd6-57bc8a38c754 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 Jun 30 15:58:17.327005 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 444/887] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:18.031072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:18.031687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:18.038455 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:18.038909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:18.039672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:18.040136 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:18.054033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c HTTP/1.1 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:58:18.055698 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:18.057581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '68500daa-944e-4945-b9f7-af668da28e2c'} Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:58:18.058554 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:18.060144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:18.061577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:58:18.061577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5f22489e-45c7-4285-9da2-d24a41c6f4f8 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 404 len: 111 microversion: 2.20 time: 0.030216 Jun 30 15:58:18.061577 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 444/888] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:18 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:58:18.067501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f1588f63-2883-4364-be62-743c5af6a5af tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '.version_select at 0x7fbbda3d1280>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:18.090447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f1588f63-2883-4364-be62-743c5af6a5af tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445147154" status: 204 len: 0 microversion: 2.20 time: 0.027464 Jun 30 15:58:18.091046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 445/889] 10.222.0.50 () {60 vars in 1258 bytes} [Thu Jun 30 15:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445147154 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 15:58:19.906462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:19.906961 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:19.913885 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:19.914332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:19.915098 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:19.915531 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:19.929037 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c HTTP/1.1 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:58:19.930575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.932225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '68500daa-944e-4945-b9f7-af668da28e2c'} Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:58:19.933252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.934700 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.936521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:58:19.936521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2cc6cddf-3964-4bd4-8e2c-b5455242665f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 404 len: 111 microversion: 2.20 time: 0.029418 Jun 30 15:58:19.936521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 445/890] 10.222.0.50 () {60 vars in 1279 bytes} [Thu Jun 30 15:58:19 2022] DELETE /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:58:19.941741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:19.942473 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 68500daa-944e-4945-b9f7-af668da28e2c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:19.949118 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:19.949566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:19.950329 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:19.950763 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:19.964255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c HTTP/1.1 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:58:19.965879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.967436 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '68500daa-944e-4945-b9f7-af668da28e2c'} Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:58:19.968547 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. Jun 30 15:58:19.969924 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:19.971331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 68500daa-944e-4945-b9f7-af668da28e2c could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:58:19.971331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dd2824c7-b830-4c7e-8609-46b532245675 tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c" status: 404 len: 111 microversion: 2.20 time: 0.030154 Jun 30 15:58:19.971331 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 446/891] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:19 2022] GET /compute/v2.1/servers/68500daa-944e-4945-b9f7-af668da28e2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:58:21.116396 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:21.116950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:21.123762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:21.124247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:21.125013 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:21.125449 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:21.138785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c HTTP/1.1 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 15:58:21.140370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.142233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '049d6e85-38af-4704-9533-28e68f38451c'} Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:58:21.143179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.144795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.146364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:58:21.146364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d1184a2a-473c-4b96-b324-9f2ad760b02b tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 404 len: 111 microversion: 2.20 time: 0.029596 Jun 30 15:58:21.146364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 446/892] 10.222.0.50 () {60 vars in 1279 bytes} [Thu Jun 30 15:58:21 2022] DELETE /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:58:21.150380 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:21.151019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] [instance: 049d6e85-38af-4704-9533-28e68f38451c] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:21.157908 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:21.158358 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:21.159146 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:21.159577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:21.173620 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] HTTP exception thrown: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Request method failure captured: Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c HTTP/1.1 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcZYSeck3K1rWLNvB3ihk9U92WXRGmviD6xYtqLjixo8bBB10_rfXGV977do4XsxNKJLpOucxyVVYjhWZVHsNBFD-R2RfvMNQHBIHelGmNWPBMqX1Q0cmXHXtzc3EBfQKyaozoGl7VznZNt9FwMRv2gLDZlD49X2_v1LUqRv6u01kr8 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 15:58:21.175333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88ea20d31df42ec9e28d8f283aa15ec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88ea20d31df42ec9e28d8f283aa15ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: f88ea20d31df42ec9e28d8f283aa15ec Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1741850219 Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 7f2f23e763704ce2b0969e24ffde9243 Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1741850219-project Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.177130 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '049d6e85-38af-4704-9533-28e68f38451c'} Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 15:58:21.178315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. Jun 30 15:58:21.179731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 15:58:21.181245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] Returning 404 to user: Instance 049d6e85-38af-4704-9533-28e68f38451c could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 15:58:21.181245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-87fac22c-b422-4ff2-b9ca-304a91da419f tempest-AttachVolumeShelveTestJSON-1741850219 tempest-AttachVolumeShelveTestJSON-1741850219-project] 10.222.0.50 "GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c" status: 404 len: 111 microversion: 2.20 time: 0.030398 Jun 30 15:58:21.181245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 447/893] 10.222.0.50 () {60 vars in 1276 bytes} [Thu Jun 30 15:58:21 2022] GET /compute/v2.1/servers/049d6e85-38af-4704-9533-28e68f38451c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 15:58:30.240830 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d8648442-3d16-4339-9897-1380bfe569c7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: .version_select at 0x7fbbda55eee0>, body: {"keypair": {"name": "tempest-keypair-1385647714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhKV/aIcrKviDdI9HdSANsT8nfpvm3otvq1syApvw0tw5VoZk8afwcGFVm4RW+d6t19OUvwHgtTFHgvX8IYOg4X0+uVYbvMxxUSeSeLsm3cKhkYT83lJywAG1rzSbohw=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:30.255228 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-d8648442-3d16-4339-9897-1380bfe569c7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:58:30.259304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-d8648442-3d16-4339-9897-1380bfe569c7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:58:30.287720 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d8648442-3d16-4339-9897-1380bfe569c7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203223 Jun 30 15:58:30.293976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 447/894] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:58:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:31.794891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1982662562", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "651f519d-cbb7-4456-8e55-c8e614147ace"}], "security_groups": [{"name": "tempest-securitygroup--401464171"}], "key_name": "tempest-keypair-1385647714", "user_data": "}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:31.802133 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:31.802767 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=24 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:31.909273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.network.neutron [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] validate_networks() for [('651f519d-cbb7-4456-8e55-c8e614147ace', None, None, None, None, None)] {{(pid=129449) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:58:32.297685 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:58:32.298082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image limits 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:58:32.298557 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:58:32.299166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image pref 0:0:0 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:58:32.299796 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.virt.hardware [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:58:32.309944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:32.310414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:32.311238 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:32.311655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:32.329472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:58:32.333620 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:58:32.345139 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Going to run 1 instances... {{(pid=129449) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:58:32.347894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:58:32.397109 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2363eaeb-b8d8-4200-bc66-79c1267b9921 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606668 Jun 30 15:58:32.398320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 448/895] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:58:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:58:32.405456 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:32.412102 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4f1b4d8a-5bd0-4e11-b9be-896b15cfa065 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:32.417493 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4f1b4d8a-5bd0-4e11-b9be-896b15cfa065 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:32.498096 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4f1b4d8a-5bd0-4e11-b9be-896b15cfa065 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:32.516458 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4f1b4d8a-5bd0-4e11-b9be-896b15cfa065 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1242 microversion: 2.1 time: 0.112201 Jun 30 15:58:32.519566 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 448/896] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:32 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:33.536865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:33.537950 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:33.546320 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:33.547030 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:33.548281 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:33.548970 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:33.652960 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:33.665147 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b5d9f882-a465-4b71-9e7a-b3191fcdb9ec tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1302 microversion: 2.1 time: 0.132913 Jun 30 15:58:33.665914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 449/897] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:33 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:34.685697 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:34.689441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:34.698949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:34.699664 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:34.700882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:34.701472 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:34.954945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:34.963100 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-83c2d65b-808c-4a9e-ac67-e30a4905646d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.283557 Jun 30 15:58:34.963703 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 449/898] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:34 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:35.395702 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-2a5169a0-2694-4aaf-8e0b-926e4c9fa37d req-3a694e44-6296-4b1f-a25e-9b39385e27ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68450f6e-540e-4501-8cfd-8d4e0073edbf", "tag": "457adecf-9d56-4af5-b80a-210abd6a1658"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:35.404998 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2a5169a0-2694-4aaf-8e0b-926e4c9fa37d req-3a694e44-6296-4b1f-a25e-9b39385e27ac service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:35.405443 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-2a5169a0-2694-4aaf-8e0b-926e4c9fa37d req-3a694e44-6296-4b1f-a25e-9b39385e27ac service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:35.417721 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-2a5169a0-2694-4aaf-8e0b-926e4c9fa37d req-3a694e44-6296-4b1f-a25e-9b39385e27ac service nova] Creating event network-changed:457adecf-9d56-4af5-b80a-210abd6a1658 for instance 68450f6e-540e-4501-8cfd-8d4e0073edbf on hv-cinder-79760 Jun 30 15:58:35.422539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-2a5169a0-2694-4aaf-8e0b-926e4c9fa37d req-3a694e44-6296-4b1f-a25e-9b39385e27ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031734 Jun 30 15:58:35.423298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 450/899] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:35.987091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:35.988292 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:36.001360 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:36.001815 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:36.002587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:36.003029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:36.139757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:36.147635 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-69944aae-03c4-4383-bf85-387e295d465a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.168510 Jun 30 15:58:36.148189 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 450/900] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:35 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:37.169772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:37.170512 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:37.178480 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:37.179016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:37.179915 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:37.180459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:37.392105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:37.413562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-035fc1dc-0906-4e75-b6f6-a92ff365e7f8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.250375 Jun 30 15:58:37.414794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 451/901] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:37 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:38.431799 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:38.432451 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:38.439564 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:38.440029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:38.440805 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:38.441237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:38.578428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:38.586699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fc2f417f-3029-46bd-b386-8876de47428a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.158731 Jun 30 15:58:38.587252 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 451/902] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:38 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:39.604265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:39.605047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:39.611601 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:39.612131 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:39.612995 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:39.613471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:39.748538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:39.756207 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-abaccdf6-8e37-42cf-9ad1-3ecf0c97a1ac tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.156151 Jun 30 15:58:39.756791 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 452/903] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:39 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:40.776791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:40.777398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:40.784148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:40.784603 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:40.785366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:40.785800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:40.914129 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:40.922974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-2b735a31-0842-4120-aed6-dc9796aa9083 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.150562 Jun 30 15:58:40.923553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 452/904] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:40 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:41.939230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:41.939857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:41.947596 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:41.948072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:41.949161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:41.949765 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:42.083583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:42.091396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d021a6e1-33ea-4827-8063-0ded2733ce8b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.156016 Jun 30 15:58:42.092117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 453/905] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:41 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:58:43.105968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:43.110001 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:43.110637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:43.116986 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:43.117462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:43.118217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:43.118641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:43.266565 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:43.276851 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-29804621-59e1-4f55-a9d7-b6fbd6e351cc tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.172182 Jun 30 15:58:43.283867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 453/906] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:43 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:44.296647 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:44.297396 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:44.301031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:44.302074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:44.308062 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:44.308481 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:44.309911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:44.310539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:44.457050 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:44.465001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e7b74182-2b86-4610-a3bd-dadb8ff34cff tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.174958 Jun 30 15:58:44.465355 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 454/907] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:44 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:45.391090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-1ddfa9a7-d4fd-4745-85e6-a2be02be4084 req-ebd4fa96-cb24-4044-9586-60f588d3c86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68450f6e-540e-4501-8cfd-8d4e0073edbf", "name": "network-vif-plugged", "status": "completed", "tag": "457adecf-9d56-4af5-b80a-210abd6a1658"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:45.395590 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:45.403761 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1ddfa9a7-d4fd-4745-85e6-a2be02be4084 req-ebd4fa96-cb24-4044-9586-60f588d3c86e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:45.404298 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1ddfa9a7-d4fd-4745-85e6-a2be02be4084 req-ebd4fa96-cb24-4044-9586-60f588d3c86e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:45.418272 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-1ddfa9a7-d4fd-4745-85e6-a2be02be4084 req-ebd4fa96-cb24-4044-9586-60f588d3c86e service nova] Creating event network-vif-plugged:457adecf-9d56-4af5-b80a-210abd6a1658 for instance 68450f6e-540e-4501-8cfd-8d4e0073edbf on hv-cinder-79760 Jun 30 15:58:45.424417 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-1ddfa9a7-d4fd-4745-85e6-a2be02be4084 req-ebd4fa96-cb24-4044-9586-60f588d3c86e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038574 Jun 30 15:58:45.426466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 454/908] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 15:58:45.482783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:45.484300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:45.492579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:45.493040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:45.493907 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:45.494595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:45.680513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:45.688956 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-dfddd845-e58d-47ae-aa99-ce298a094d9e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.211727 Jun 30 15:58:45.690589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 455/909] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:45 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:46.253120 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-842481654", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-457533439", "security_groups": [{"name": "tempest-secgroup-smoke-690202865"}], "block_device_mapping_v2": [{"uuid": "7d6bc6dc-cb97-4b9c-ac43-ea4de1c74a4a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "33f28908-5ff2-4a8b-a553-d1f2fd3a4df7"}]}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:46.367637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] validate_networks() for [('33f28908-5ff2-4a8b-a553-d1f2fd3a4df7', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:58:46.709830 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:46.710528 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:46.717543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:46.717992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:46.718763 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:46.719195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:46.965431 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:46.974432 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4efe3191-fed4-4044-b4cb-ea65dda789d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1367 microversion: 2.1 time: 0.270646 Jun 30 15:58:46.975006 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 456/910] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:46 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:46.985599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:58:46.986179 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:58:46.986711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:58:46.987229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:58:46.987694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:58:46.997705 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:46.998149 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:46.998932 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:46.999393 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:47.016084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:58:47.020291 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Getting quotas for user 2de768b55f9a495295113de2ce1279e5 and project affc1e688df04803bb823ccadf904c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:58:47.078378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:58:47.080686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d6bc6dc-cb97-4b9c-ac43-ea4de1c74a4a',volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:58:47.227022 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9f57bc19-e32b-4960-80b5-218f9afbde78 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.978087 Jun 30 15:58:47.227795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 455/911] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:58:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:58:47.238813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b0c6365b-006f-4259-b93f-f30e75cf3fc1 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:47.239815 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b0c6365b-006f-4259-b93f-f30e75cf3fc1 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:47.325788 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b0c6365b-006f-4259-b93f-f30e75cf3fc1 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:47.334309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b0c6365b-006f-4259-b93f-f30e75cf3fc1 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1093 microversion: 2.1 time: 0.099426 Jun 30 15:58:47.335110 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 457/912] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:47 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:47.990743 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:47.991357 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:47.999108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:47.999557 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.000398 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:48.000855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.139294 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:48.147424 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-53626f9e-abd6-4124-92e6-dd277f4b7b55 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1557 microversion: 2.1 time: 0.160627 Jun 30 15:58:48.148024 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 456/913] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:47 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:48.164247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:48.164769 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:48.171661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:48.172161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.172987 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:48.173562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.251933 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-bfc8ce6f-1717-411c-bb6c-b2241053d6f9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091476 Jun 30 15:58:48.252693 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 458/914] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:58:48 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:48.360314 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:48.361254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:48.368319 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:48.369469 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.370349 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:48.371084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:48.497497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:48.508845 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6d8e365d-0fc6-4ac6-87b0-afb4719523f2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1199 microversion: 2.1 time: 0.152289 Jun 30 15:58:48.510211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 457/915] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:48 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1199 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:49.527612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:49.528219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:49.534642 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:49.535095 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:49.535867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:49.536335 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:49.729744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:49.738726 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-66a6a9b9-42d2-482f-9c79-728335fb528b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1209 microversion: 2.1 time: 0.215474 Jun 30 15:58:49.739317 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 459/916] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:49 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1209 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:50.287015 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-78938f8a-4d73-41dc-879b-ed584358f6f7 req-7de73042-c76e-4215-9e22-9419c7c6da68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68450f6e-540e-4501-8cfd-8d4e0073edbf", "tag": "457adecf-9d56-4af5-b80a-210abd6a1658"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:50.298182 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-78938f8a-4d73-41dc-879b-ed584358f6f7 req-7de73042-c76e-4215-9e22-9419c7c6da68 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:50.298627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-78938f8a-4d73-41dc-879b-ed584358f6f7 req-7de73042-c76e-4215-9e22-9419c7c6da68 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:50.313866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-78938f8a-4d73-41dc-879b-ed584358f6f7 req-7de73042-c76e-4215-9e22-9419c7c6da68 service nova] Creating event network-changed:457adecf-9d56-4af5-b80a-210abd6a1658 for instance 68450f6e-540e-4501-8cfd-8d4e0073edbf on hv-cinder-79760 Jun 30 15:58:50.319030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-78938f8a-4d73-41dc-879b-ed584358f6f7 req-7de73042-c76e-4215-9e22-9419c7c6da68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036633 Jun 30 15:58:50.319929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 458/917] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:50.756248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:50.756866 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:50.763367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:50.763722 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:50.764536 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:50.764999 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:50.901714 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:50.909799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6d39ae9b-5ef1-425e-a8c5-1410a7f6f1d0 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1276 microversion: 2.1 time: 0.157331 Jun 30 15:58:50.910413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 460/918] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:50 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:51.927588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:51.928397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:51.935863 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:51.936342 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:51.937166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:51.937640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:52.255000 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:52.263144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-91206a57-69ea-4e7c-8cf5-783aff6d4ee7 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1276 microversion: 2.1 time: 0.339770 Jun 30 15:58:52.263725 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 459/919] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:51 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:52.712156 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-f50beb7d-a456-46ed-90f5-c8f4cbd74062 req-40980206-dd58-4f0b-aa03-f090afb96126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3748b-5b67-4851-97d3-890a110f7e44", "tag": "c8d9a561-eeef-41e9-9ddd-baddd7460f2f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:58:52.722931 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f50beb7d-a456-46ed-90f5-c8f4cbd74062 req-40980206-dd58-4f0b-aa03-f090afb96126 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:52.723403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f50beb7d-a456-46ed-90f5-c8f4cbd74062 req-40980206-dd58-4f0b-aa03-f090afb96126 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:52.742621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-f50beb7d-a456-46ed-90f5-c8f4cbd74062 req-40980206-dd58-4f0b-aa03-f090afb96126 service nova] Creating event network-changed:c8d9a561-eeef-41e9-9ddd-baddd7460f2f for instance bdb3748b-5b67-4851-97d3-890a110f7e44 on hv-cinder-79760 Jun 30 15:58:52.748483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-f50beb7d-a456-46ed-90f5-c8f4cbd74062 req-40980206-dd58-4f0b-aa03-f090afb96126 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040552 Jun 30 15:58:52.749935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 461/920] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:58:53.280464 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:53.281147 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:53.288066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:53.288514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:53.289298 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:53.289726 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:53.429265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:53.438660 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8498ec21-5695-471b-91c1-1a8c6039c155 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.162165 Jun 30 15:58:53.439231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 460/921] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:53 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:54.457296 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:54.458019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:54.465054 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:54.465507 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:54.466382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:54.466823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:54.613624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:54.621497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-878ea94a-968e-4669-a8a2-be78d9071b7f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.168496 Jun 30 15:58:54.622059 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 462/922] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:54 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:55.638068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:55.638806 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:55.645585 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:55.646028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:55.646781 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:55.647191 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:55.781267 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:55.789625 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9d726cec-c04b-4b66-9442-0923288e3e8d tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.155440 Jun 30 15:58:55.790123 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 461/923] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:55 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:56.808296 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:56.809094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:56.815942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:56.816540 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:56.817292 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:56.817739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:56.954663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:56.962532 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-15447964-81bd-4395-af63-716f5262d301 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.159500 Jun 30 15:58:56.963168 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 463/924] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:56 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:57.980020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:57.980785 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:57.985027 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:57.985768 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:57.991428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:57.991879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:57.992722 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:57.993110 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:58.130173 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:58.137898 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0f71c923-a13d-42b9-8ea1-ef0159d9faba tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.161925 Jun 30 15:58:58.138563 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 462/925] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:57 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:58:59.155224 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:58:59.155810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:58:59.157765 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:58:59.163948 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:59.164408 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:59.165189 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:58:59.165666 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:58:59.374408 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:58:59.382579 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4f267d64-b7cb-4ea5-b615-92dbf8a9ccfb tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.231379 Jun 30 15:58:59.383157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 464/926] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:58:59 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:00.399087 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:00.399665 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:00.406751 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:00.407208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:00.408379 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:00.408379 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:00.543526 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:00.553023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f5d2f1b5-9abd-42ef-93f4-5fba3fb136a8 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.157908 Jun 30 15:59:00.553582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 463/927] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:00 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:01.571890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:01.572495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:01.580010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:01.580478 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:01.581399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:01.581921 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:01.715360 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:01.723890 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-14f4a96f-5483-48d1-86d3-aff26918190f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.156162 Jun 30 15:59:01.724498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 465/928] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:01 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:02.741427 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:02.742036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:02.748227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:02.748672 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:02.749423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:02.749877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:02.753812 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=79 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:02.887715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:02.895642 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-61da84da-493a-4bf5-8089-3db89b8acc68 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.158356 Jun 30 15:59:02.896234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 464/929] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:02 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:03.873284 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-a8a8b5c7-f2bf-45fb-9140-6962eb6378b1 req-17c2e487-2365-42c3-85ff-736ec2963c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3748b-5b67-4851-97d3-890a110f7e44", "name": "network-vif-plugged", "status": "completed", "tag": "c8d9a561-eeef-41e9-9ddd-baddd7460f2f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:03.878250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:03.884328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a8a8b5c7-f2bf-45fb-9140-6962eb6378b1 req-17c2e487-2365-42c3-85ff-736ec2963c4f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:03.885337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a8a8b5c7-f2bf-45fb-9140-6962eb6378b1 req-17c2e487-2365-42c3-85ff-736ec2963c4f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:03.890876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=89 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:03.902804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-a8a8b5c7-f2bf-45fb-9140-6962eb6378b1 req-17c2e487-2365-42c3-85ff-736ec2963c4f service nova] Creating event network-vif-plugged:c8d9a561-eeef-41e9-9ddd-baddd7460f2f for instance bdb3748b-5b67-4851-97d3-890a110f7e44 on hv-cinder-79760 Jun 30 15:59:03.913336 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:03.913983 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:03.922020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-a8a8b5c7-f2bf-45fb-9140-6962eb6378b1 req-17c2e487-2365-42c3-85ff-736ec2963c4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052335 Jun 30 15:59:03.922812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 466/930] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:03.929575 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:03.930245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:03.931233 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:03.931681 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:04.072605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:04.080555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d30eeedf-c202-458b-b13e-0b78ffeed963 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.171240 Jun 30 15:59:04.081234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 465/931] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:03 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:05.099292 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:05.100031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:05.106251 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:05.106694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:05.107453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:05.107886 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:05.253897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:05.262180 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c698b3cc-31be-4b82-9703-1d501246a8e2 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1264 microversion: 2.1 time: 0.167955 Jun 30 15:59:05.270588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 467/932] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:05 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:06.283256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:06.284256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:06.291238 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:06.291690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:06.292515 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:06.293059 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:06.438164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:06.445633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-25930719-beae-448b-bff7-90fedc98e770 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1450 microversion: 2.1 time: 0.169000 Jun 30 15:59:06.446563 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 466/933] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:06 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:06.461853 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:06.462491 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:06.469090 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:06.469542 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:06.470667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:06.471104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:06.622852 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:06.630827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a767ab42-79b9-40fe-bd3e-ce2517356e74 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1450 microversion: 2.1 time: 0.172859 Jun 30 15:59:06.631400 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 468/934] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:06 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:08.674466 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-10a08657-abc8-4155-b8bb-0e1c323875f8 req-cfbe30c3-a410-41c4-9816-24be2d2e7862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3748b-5b67-4851-97d3-890a110f7e44", "tag": "c8d9a561-eeef-41e9-9ddd-baddd7460f2f"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:08.683118 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-10a08657-abc8-4155-b8bb-0e1c323875f8 req-cfbe30c3-a410-41c4-9816-24be2d2e7862 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:08.683588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-10a08657-abc8-4155-b8bb-0e1c323875f8 req-cfbe30c3-a410-41c4-9816-24be2d2e7862 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:08.694892 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-10a08657-abc8-4155-b8bb-0e1c323875f8 req-cfbe30c3-a410-41c4-9816-24be2d2e7862 service nova] Creating event network-changed:c8d9a561-eeef-41e9-9ddd-baddd7460f2f for instance bdb3748b-5b67-4851-97d3-890a110f7e44 on hv-cinder-79760 Jun 30 15:59:08.700180 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-10a08657-abc8-4155-b8bb-0e1c323875f8 req-cfbe30c3-a410-41c4-9816-24be2d2e7862 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029336 Jun 30 15:59:08.700896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 467/935] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:17.742116 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:17.742723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:17.745497 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=5 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:17.746194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=13 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:17.752867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:17.753319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:17.754063 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:17.754503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:17.777901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lazy-loading 'flavor' on Instance uuid 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 15:59:17.854374 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4115a5bb-f838-4052-9d3c-94607da44b48 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "POST /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686/action" status: 202 len: 0 microversion: 2.1 time: 0.116093 Jun 30 15:59:17.855106 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 469/936] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:59:17 2022] POST /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:59:17.865410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:17.866097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:17.868109 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:17.874457 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:17.874980 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:17.875930 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:17.876378 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:18.019535 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:18.027925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-8973269b-b836-4d40-b42d-eb98bc4d3602 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.168220 Jun 30 15:59:18.028523 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 468/937] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:17 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:19.054726 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:19.055780 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:19.066434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:19.067185 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:19.068437 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:19.069206 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:19.228611 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:19.236675 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-64ef4528-bd96-4689-aba8-c1f6603be43a tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.189958 Jun 30 15:59:19.237250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 470/938] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:19 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:20.258760 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:20.259780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:20.271016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:20.271761 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:20.273073 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:20.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:20.409997 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:20.418175 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1ce1892a-8cea-4bff-a89a-1c5e0fee1bce tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.166127 Jun 30 15:59:20.418711 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 469/939] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:20 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:21.443305 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:21.444362 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:21.455571 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:21.456454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:21.457698 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:21.458485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:21.604174 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:21.611935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1763f95e-a52e-47f9-b41a-adc698cac8c0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.175102 Jun 30 15:59:21.612537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 471/940] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:21 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:22.632950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:22.633914 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:22.644972 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:22.645770 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:22.647045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:22.647773 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:22.787544 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:22.795834 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1e6fb355-4b08-4e5e-b368-d32f12fec3a5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.169573 Jun 30 15:59:22.796429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 470/941] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:22 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:23.822807 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:23.823639 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:23.834103 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:23.834558 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:23.835323 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:23.835761 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:23.975594 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:23.983268 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-da59f0d7-c7da-463d-bb03-1639c0df7857 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.167234 Jun 30 15:59:23.983836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 472/942] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:23 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:25.004483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:25.005500 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:25.012866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:25.013322 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:25.014113 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:25.014549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:25.153250 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:25.164897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5cfb63cc-c340-4b08-8106-19dd69771877 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.166689 Jun 30 15:59:25.165712 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 471/943] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:24 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:26.183559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:26.184203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:26.191337 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:26.191789 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:26.192556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:26.193126 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:26.337925 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:26.346517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d97c567d-3678-43ce-9a8b-3a3edd62e72e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.166884 Jun 30 15:59:26.347087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 473/944] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:26 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:26.391386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:26.391923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:26.399151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:26.399635 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:26.400571 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:26.401071 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:26.425410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-9f9b71ee-cca3-436f-bc79-94c2b9981889 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/ips" status: 200 len: 150 microversion: 2.1 time: 0.037959 Jun 30 15:59:26.425969 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 472/945] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 15:59:26 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:27.367488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:27.368168 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:27.377551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:27.378003 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:27.378755 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:27.379194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:27.516490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:27.524720 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-56b23f5c-1d20-4902-bba1-b8d3876d882e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.163123 Jun 30 15:59:27.525278 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 474/946] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:27 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:27.797092 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59c65876-3188-4363-98ea-0bdf388e0fd0"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:27.798217 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:27.806670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:27.807116 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:27.807879 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:27.808343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:28.056412 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-0049a1ee-457a-44af-af89-eec9ba0fcea6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263153 Jun 30 15:59:28.060534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 473/947] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 15:59:27 2022] POST /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:28.546654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:28.547273 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:28.555064 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:28.555498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:28.556288 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:28.556713 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:28.698857 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:28.706894 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-52810387-57c6-49c1-b70c-89a5fe9e8619 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.164157 Jun 30 15:59:28.707460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 475/948] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:28 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:29.730542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:29.731685 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:29.741597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:29.742066 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:29.742824 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:29.743256 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:29.888707 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:29.896941 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3e77375e-c465-4890-b65d-ca3e40ea76be tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.174396 Jun 30 15:59:29.897498 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 474/949] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:29 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:30.918635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:30.919597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:30.930792 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:30.931539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:30.932839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:30.933552 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:31.077004 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:31.084884 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-20941c08-23b9-4a1e-b6ac-1228713b6320 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.172892 Jun 30 15:59:31.085419 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 476/950] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:30 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:32.102840 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:32.103433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:32.110593 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:32.111042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:32.111832 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:32.112303 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:32.246519 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:32.257623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-337b3a0a-878a-49c1-a473-284a8165f22c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.158783 Jun 30 15:59:32.258218 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 475/951] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:32 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:33.274983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:33.275587 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:33.283688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:33.284150 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:33.284942 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:33.285366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:33.489195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:33.497311 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1a793e19-d889-4264-b58e-d0754789aa94 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.226369 Jun 30 15:59:33.497876 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 477/952] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:33 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:34.514695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:34.515304 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:34.522164 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:34.522619 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:34.523369 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:34.523800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:34.526451 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:34.675916 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:34.683877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c12dfbc5-2dbe-4558-8cf1-359d0c95e493 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.173005 Jun 30 15:59:34.684480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 476/953] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:34 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:35.709494 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:35.710126 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:35.716702 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:35.717142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:35.718132 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:35.718909 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:35.852233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:35.860120 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5f9e8dbc-043e-4115-b063-7da60b98a1df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.162066 Jun 30 15:59:35.860682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 478/954] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:35 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:36.670390 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-43b46b3f-f22b-4a87-b810-3e0895442ed6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: .version_select at 0x7fbbda606820>, body: {"keypair": {"name": "tempest-keypair-1309546889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF17E8hYeWxe7P42TB3ivHZSYgNTTfc3Tj7nL0agSBE6iLrf9qjnzBxSN0Kw4tMcj1iOA7ATgZFplD5fxr5iau8MCwr/U9Y7DLSKX443IaB+7bwTIFK0XS+p0sixHoYi6A=="}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:36.686555 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-43b46b3f-f22b-4a87-b810-3e0895442ed6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:59:36.691078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-43b46b3f-f22b-4a87-b810-3e0895442ed6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:59:36.718184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-43b46b3f-f22b-4a87-b810-3e0895442ed6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051729 Jun 30 15:59:36.719124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 477/955] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 15:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:36.877589 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:36.878201 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:36.885312 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:36.885783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:36.886562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:36.886980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:37.084843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:37.092584 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-4db4706a-36e6-4af0-9723-da49cfd5681d tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1511 microversion: 2.1 time: 0.218922 Jun 30 15:59:37.093833 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 479/956] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:36 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:37.109644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:37.110222 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:37.117088 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:37.117609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:37.118475 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:37.118990 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:37.216772 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e963e347-c3a7-4335-a175-f1c0eddcfee6 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "POST /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686/action" status: 202 len: 0 microversion: 2.1 time: 0.110074 Jun 30 15:59:37.217860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 478/957] 10.222.0.50 () {60 vars in 1277 bytes} [Thu Jun 30 15:59:37 2022] POST /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 15:59:37.230257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:37.230969 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:37.239157 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:37.239739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:37.240865 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:37.241407 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:37.383413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:37.391939 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-11a00a3f-83a1-47cf-852a-7368a605a9f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1519 microversion: 2.1 time: 0.167945 Jun 30 15:59:37.401759 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 480/958] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:37 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:38.226029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2058391651", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "651f519d-cbb7-4456-8e55-c8e614147ace"}], "security_groups": [{"name": "tempest-securitygroup--815406034"}], "key_name": "tempest-keypair-1309546889", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:38.327494 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] validate_networks() for [('651f519d-cbb7-4456-8e55-c8e614147ace', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 15:59:38.409401 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:38.410128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:38.417233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:38.417799 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:38.418656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:38.419163 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:38.641265 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:38.651775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-88bec8da-3469-4c42-b815-d6d8adb5b11c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1521 microversion: 2.1 time: 0.245713 Jun 30 15:59:38.652726 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 481/959] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:38 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:38.791592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 15:59:38.792031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 15:59:38.792505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 15:59:38.792909 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 15:59:38.793313 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 15:59:38.802621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:38.803087 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:38.803881 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:38.804340 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:38.820568 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 15:59:38.824520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 15:59:38.837025 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 15:59:38.840184 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 15:59:38.901890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a8dfb145-21bb-49ab-8d33-5b539cf81b1a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680174 Jun 30 15:59:38.902480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 479/960] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 15:59:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 15:59:38.912676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b800a58f-dc6c-4a97-9d52-7d0dd4cb2255 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:38.913421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b800a58f-dc6c-4a97-9d52-7d0dd4cb2255 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:38.975866 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b800a58f-dc6c-4a97-9d52-7d0dd4cb2255 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:38.982636 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b800a58f-dc6c-4a97-9d52-7d0dd4cb2255 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1242 microversion: 2.1 time: 0.073985 Jun 30 15:59:38.983186 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 482/961] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:38 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:39.670134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:39.670719 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:39.677354 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:39.677787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:39.678549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:39.678981 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:39.820428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:39.828097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-17b43251-af25-43e0-9aa5-f96e54b7171e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.162615 Jun 30 15:59:39.828628 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 480/962] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:39 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:39.957861 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-16ec0888-5e8c-4064-b385-e912a4792257 req-e3b6bc1d-587d-4ef7-9812-0a136430ab64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "name": "network-vif-unplugged", "status": "completed", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:39.968725 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-16ec0888-5e8c-4064-b385-e912a4792257 req-e3b6bc1d-587d-4ef7-9812-0a136430ab64 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:39.970207 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-16ec0888-5e8c-4064-b385-e912a4792257 req-e3b6bc1d-587d-4ef7-9812-0a136430ab64 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:39.981434 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-16ec0888-5e8c-4064-b385-e912a4792257 req-e3b6bc1d-587d-4ef7-9812-0a136430ab64 service nova] Creating event network-vif-unplugged:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 15:59:39.986984 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-16ec0888-5e8c-4064-b385-e912a4792257 req-e3b6bc1d-587d-4ef7-9812-0a136430ab64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032624 Jun 30 15:59:39.987577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 483/963] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:40.001060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:40.001680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:40.008248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:40.008680 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:40.009715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:40.010316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:40.108213 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:40.116332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-12e877c7-7347-44d6-abef-e038156f3c19 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1302 microversion: 2.1 time: 0.119323 Jun 30 15:59:40.116910 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 481/964] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:39 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:59:40.846413 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:40.847535 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:40.854513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:40.855338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:40.856219 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:40.856739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:41.104476 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:41.112377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1d3c2e01-770b-4311-ae30-148eafc1f07c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.270700 Jun 30 15:59:41.112952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 484/965] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:40 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:41.133887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:41.134460 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:41.141434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:41.141858 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:41.142848 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:41.143284 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:41.622790 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:41.633765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-160cb89d-ce3a-4b31-bc87-2ad01a67444b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.501570 Jun 30 15:59:41.635520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 482/966] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:41 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:41.852622 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-f2bba50d-1aef-4061-a2a3-39c6189b5dff req-cfc6b5ff-34e5-40fe-be52-4059555341f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e0a0af-66ed-46c0-955c-b042acc8f51e", "tag": "0522fc86-8027-4c64-aa94-261adbd99707"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:41.863223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f2bba50d-1aef-4061-a2a3-39c6189b5dff req-cfc6b5ff-34e5-40fe-be52-4059555341f1 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:41.864249 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f2bba50d-1aef-4061-a2a3-39c6189b5dff req-cfc6b5ff-34e5-40fe-be52-4059555341f1 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:41.871741 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:41.885524 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-f2bba50d-1aef-4061-a2a3-39c6189b5dff req-cfc6b5ff-34e5-40fe-be52-4059555341f1 service nova] Creating event network-changed:0522fc86-8027-4c64-aa94-261adbd99707 for instance 56e0a0af-66ed-46c0-955c-b042acc8f51e on hv-cinder-79760 Jun 30 15:59:41.890921 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-f2bba50d-1aef-4061-a2a3-39c6189b5dff req-cfc6b5ff-34e5-40fe-be52-4059555341f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042390 Jun 30 15:59:41.892429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 485/967] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:42.129903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:42.130626 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:42.137247 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:42.137884 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:42.138516 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:42.138954 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:42.349353 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:42.357613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-96e08cbe-ea4b-4e26-91a4-2eacc19168f9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.231653 Jun 30 15:59:42.358165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 483/968] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:42 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:42.656831 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:42.657935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:42.668755 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:42.669190 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:42.669943 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:42.670370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:42.802850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:42.810395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2c7ce8f9-92f0-4ff4-9eff-c63e9695a29d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.160890 Jun 30 15:59:42.810952 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 486/969] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:42 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:43.376637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:43.377258 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:43.384174 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:43.384628 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:43.385500 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:43.385934 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:43.709877 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:43.718328 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ca5c53e7-cb30-4bf7-9048-6b181177b61c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.345260 Jun 30 15:59:43.718912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 484/970] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:43 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:43.826914 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:43.827661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:43.834549 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:43.834982 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:43.835771 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:43.836257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:44.083223 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:44.091295 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-77b82e02-1fa6-4efe-a960-397c7c72887c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.268254 Jun 30 15:59:44.092016 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 487/971] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:43 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:44.739714 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:44.740695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:44.748968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:44.749419 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:44.750185 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:44.750627 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:44.893461 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:44.901613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-acab7cf1-e3fc-468d-917a-2530591fa67c tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.168516 Jun 30 15:59:44.902198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 485/972] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:44 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:45.113955 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:45.114900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:45.126266 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:45.127037 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:45.128345 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:45.129075 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:45.265370 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:45.273551 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-00abb6aa-6103-40b6-b2a2-6b3ea9bd2ac0 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.166946 Jun 30 15:59:45.274104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 488/973] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:45 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:45.919041 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:45.919641 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:45.926599 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:45.927045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:45.927801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:45.928259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:46.117240 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:46.131709 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-831b6e6b-3503-449b-aa36-6fb9d034b34e tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.216729 Jun 30 15:59:46.132319 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 486/974] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:45 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:46.290773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:46.291454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:46.298238 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:46.298688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:46.299456 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:46.299891 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:46.457297 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:46.465213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b0bd0bc3-a956-46c7-9295-25c17c2e7c51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.178148 Jun 30 15:59:46.465775 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 489/975] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:46 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:47.153152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:47.154155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:47.165389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:47.166152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:47.167134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:47.167576 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:47.304289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:47.315523 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-c613d1e2-8165-4e48-a59a-ec519f6b1bb7 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1577 microversion: 2.1 time: 0.168576 Jun 30 15:59:47.316558 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 487/976] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:47 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:47.482709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:47.483310 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:47.489947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:47.490399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:47.491166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:47.491597 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:47.627143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:47.639383 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-60b15f6a-6a6d-4dd4-85b6-0b53106989ab tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.160411 Jun 30 15:59:47.640348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 490/977] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:47 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 15:59:48.333421 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-38437ec9-add8-4032-9567-42fa6a0fbafc req-62d4085e-e07a-41b6-8d84-9a3e07ec4fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e0a0af-66ed-46c0-955c-b042acc8f51e", "name": "network-vif-plugged", "status": "completed", "tag": "0522fc86-8027-4c64-aa94-261adbd99707"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:48.336604 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:48.337454 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:48.340386 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=47 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:48.341446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:48.344648 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-38437ec9-add8-4032-9567-42fa6a0fbafc req-62d4085e-e07a-41b6-8d84-9a3e07ec4fa2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:48.345433 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-38437ec9-add8-4032-9567-42fa6a0fbafc req-62d4085e-e07a-41b6-8d84-9a3e07ec4fa2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:48.346730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:48.347693 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:48.348836 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:48.349504 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:48.358640 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-38437ec9-add8-4032-9567-42fa6a0fbafc req-62d4085e-e07a-41b6-8d84-9a3e07ec4fa2 service nova] Creating event network-vif-plugged:0522fc86-8027-4c64-aa94-261adbd99707 for instance 56e0a0af-66ed-46c0-955c-b042acc8f51e on hv-cinder-79760 Jun 30 15:59:48.363795 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-38437ec9-add8-4032-9567-42fa6a0fbafc req-62d4085e-e07a-41b6-8d84-9a3e07ec4fa2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Jun 30 15:59:48.364578 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 488/978] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:48.500813 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:48.508595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1f7b3c27-294a-45fa-b14d-bff931be42bd tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1564 microversion: 2.1 time: 0.176748 Jun 30 15:59:48.509701 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 491/979] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:48 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:48.661548 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:48.662354 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:48.669465 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:48.669915 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:48.670671 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:48.671106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:48.799130 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:48.806874 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ff44af3a-909d-4ff0-a0e4-5e36eff07bbb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.149662 Jun 30 15:59:48.807441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 489/980] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:48 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:49.827821 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:49.828829 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:49.831841 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:49.841598 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:49.842037 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:49.843150 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:49.843578 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:49.974530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:49.982087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-626a5bc9-9d7e-4fe5-8dec-ef1d525cc6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1367 microversion: 2.1 time: 0.160776 Jun 30 15:59:49.982650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 492/981] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:49 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:50.388346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-d0da02c2-95b8-47eb-811d-bc6189ea3b4f req-4ff8ea6c-be22-4cd2-a432-71e0b1ea7277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "name": "network-vif-plugged", "status": "completed", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:50.394316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:50.395397 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=10 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 15:59:50.405628 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d0da02c2-95b8-47eb-811d-bc6189ea3b4f req-4ff8ea6c-be22-4cd2-a432-71e0b1ea7277 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:50.406068 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-d0da02c2-95b8-47eb-811d-bc6189ea3b4f req-4ff8ea6c-be22-4cd2-a432-71e0b1ea7277 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:50.417244 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-d0da02c2-95b8-47eb-811d-bc6189ea3b4f req-4ff8ea6c-be22-4cd2-a432-71e0b1ea7277 service nova] Creating event network-vif-plugged:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 15:59:50.422364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-d0da02c2-95b8-47eb-811d-bc6189ea3b4f req-4ff8ea6c-be22-4cd2-a432-71e0b1ea7277 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040391 Jun 30 15:59:50.422917 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 490/982] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:51.002980 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:51.003911 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:51.014196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:51.014652 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:51.015447 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:51.015878 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:51.154678 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 15:59:51.162631 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-110c13ed-6006-4879-9d93-fa510c43a85c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1557 microversion: 2.1 time: 0.166272 Jun 30 15:59:51.163203 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 493/983] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 15:59:50 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 15:59:51.180553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 15:59:51.181333 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 15:59:51.189029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:51.189482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:51.190246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:51.190687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:51.282203 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7f8d547d-25c1-4ecf-912e-cf2aee893762 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106737 Jun 30 15:59:51.282800 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 491/984] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 15:59:51 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 15:59:52.203271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-a57462df-a11d-4f85-89e6-5b16223bd5cd req-e3daff84-2c98-4982-a7cd-88ef697c6541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e0a0af-66ed-46c0-955c-b042acc8f51e", "tag": "0522fc86-8027-4c64-aa94-261adbd99707"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 15:59:52.211772 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a57462df-a11d-4f85-89e6-5b16223bd5cd req-e3daff84-2c98-4982-a7cd-88ef697c6541 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 15:59:52.212240 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-a57462df-a11d-4f85-89e6-5b16223bd5cd req-e3daff84-2c98-4982-a7cd-88ef697c6541 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 15:59:52.223832 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-a57462df-a11d-4f85-89e6-5b16223bd5cd req-e3daff84-2c98-4982-a7cd-88ef697c6541 service nova] Creating event network-changed:0522fc86-8027-4c64-aa94-261adbd99707 for instance 56e0a0af-66ed-46c0-955c-b042acc8f51e on hv-cinder-79760 Jun 30 15:59:52.228875 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-a57462df-a11d-4f85-89e6-5b16223bd5cd req-e3daff84-2c98-4982-a7cd-88ef697c6541 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029366 Jun 30 15:59:52.229490 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 494/985] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:28.419083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=7 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:28.420374 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:28.426583 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:28.427079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:28.435285 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.435637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.436410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.436844 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.462078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1eee7fff-7776-4977-891e-c8d1e10a8090 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/ips" status: 200 len: 150 microversion: 2.1 time: 0.045913 Jun 30 16:00:28.462652 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 492/986] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 16:00:28 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:28.471676 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=7 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:28.472403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=50 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:28.477123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59c65876-3188-4363-98ea-0bdf388e0fd0"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:28.478276 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:28.485357 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.485806 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.486572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.487007 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.567156 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: POST /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/os-volume_attachments HTTP/1.1 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 74 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:00:28.568946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {"volumeAttachment": {"volumeId": "59c65876-3188-4363-98ea-0bdf388e0fd0"}} Jun 30 16:00:28.570593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'server_id': '56e0a0af-66ed-46c0-955c-b042acc8f51e', 'body': {'volumeAttachment': {'volumeId': '59c65876-3188-4363-98ea-0bdf388e0fd0'}}} Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:28.571460 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:28.572898 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 400 to user: Invalid volume: volume 59c65876-3188-4363-98ea-0bdf388e0fd0 is already attached to instances: 68450f6e-540e-4501-8cfd-8d4e0073edbf {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0f1bde7b-0a3f-4a05-8cb9-d072aac4f63f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100582 Jun 30 16:00:28.574196 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 495/987] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 16:00:28 2022] POST /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:00:28.579231 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:28.579734 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:28.586041 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.586489 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.587248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.587686 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.612446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:00:28.695044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-b401c14f-b5cc-4980-abb0-a3d01c720d5a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 204 len: 0 microversion: 2.1 time: 0.119300 Jun 30 16:00:28.695779 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 493/988] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:00:28 2022] DELETE /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:00:28.704333 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:28.704988 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:28.711920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.712432 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.713195 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:28.713621 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:28.850258 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:28.858459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6cbf1fb8-bc25-4d6f-9297-58464aa47dfd tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1682 microversion: 2.1 time: 0.158125 Jun 30 16:00:28.859015 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 496/989] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:28 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:29.877318 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:29.878026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:29.884790 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:29.885245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:29.886010 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:29.886445 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:30.024689 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:30.032679 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-6c7b92b7-d6b9-4864-bd2e-f9732b33c752 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1682 microversion: 2.1 time: 0.159667 Jun 30 16:00:30.033246 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 494/990] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:29 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:31.002592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-4eede54f-6d31-4907-af6d-1e5db8edd11c req-d44d5dab-a7ee-43dc-bd4e-462dcc0077eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e0a0af-66ed-46c0-955c-b042acc8f51e", "name": "network-vif-deleted", "tag": "0522fc86-8027-4c64-aa94-261adbd99707"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:31.012452 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4eede54f-6d31-4907-af6d-1e5db8edd11c req-d44d5dab-a7ee-43dc-bd4e-462dcc0077eb service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:31.012983 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-4eede54f-6d31-4907-af6d-1e5db8edd11c req-d44d5dab-a7ee-43dc-bd4e-462dcc0077eb service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:31.025322 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-4eede54f-6d31-4907-af6d-1e5db8edd11c req-d44d5dab-a7ee-43dc-bd4e-462dcc0077eb service nova] Creating event network-vif-deleted:0522fc86-8027-4c64-aa94-261adbd99707 for instance 56e0a0af-66ed-46c0-955c-b042acc8f51e on hv-cinder-79760 Jun 30 16:00:31.031978 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-4eede54f-6d31-4907-af6d-1e5db8edd11c req-d44d5dab-a7ee-43dc-bd4e-462dcc0077eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033258 Jun 30 16:00:31.032867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 497/991] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:31.050448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:31.051277 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:31.058106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:31.058637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:31.059518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:31.060172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:31.212638 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:31.221248 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-1cb9a8e1-cbc1-4e20-b8f6-7ba73fa3130f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 200 len: 1327 microversion: 2.1 time: 0.174935 Jun 30 16:00:31.221862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 495/992] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:31 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:32.243271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:32.244105 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:32.253459 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:32.253932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:32.254969 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:32.255471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:32.269416 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e HTTP/1.1 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:00:32.271143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:00:32.272889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '56e0a0af-66ed-46c0-955c-b042acc8f51e'} Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:32.273795 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:00:32.275135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:32.276399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:32.276399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ea111533-24ff-4c4e-91ee-51c68b06db65 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 404 len: 111 microversion: 2.1 time: 0.036843 Jun 30 16:00:32.276399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 498/993] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:32 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:00:32.281862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a2da7f81-6a64-4578-acfb-52e9f7931fb5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '.version_select at 0x7fbbda5f3040>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:32.301943 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a2da7f81-6a64-4578-acfb-52e9f7931fb5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309546889" status: 202 len: 0 microversion: 2.1 time: 0.024086 Jun 30 16:00:32.302504 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 496/994] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 16:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309546889 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:00:32.990616 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:32.991215 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:32.997805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:32.998260 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:32.999025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:32.999492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:33.196380 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lazy-loading 'services' on Instance uuid 68450f6e-540e-4501-8cfd-8d4e0073edbf {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:00:33.286210 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b355d583-788e-4fb6-96f6-8bcb85dba108 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments/59c65876-3188-4363-98ea-0bdf388e0fd0" status: 202 len: 0 microversion: 2.1 time: 0.299505 Jun 30 16:00:33.286808 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 499/995] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 16:00:32 2022] DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments/59c65876-3188-4363-98ea-0bdf388e0fd0 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:00:33.296185 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:33.297207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:33.304154 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:33.304682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:33.305470 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:33.305904 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:33.335104 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7c4c460b-3ad1-48f8-bddb-0795ceb0da89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Jun 30 16:00:33.339076 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 497/996] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:00:33 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:34.353128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:34.354777 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:34.364523 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.364975 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.365737 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.366173 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.395146 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-25d95803-a0f6-41be-94a9-4dbe03d44747 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050343 Jun 30 16:00:34.395689 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 500/997] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:00:34 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:00:34.453033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:34.453579 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:34.460313 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.460618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.461376 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.461801 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.489549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:00:34.584430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-36f3c0fa-fd13-4a00-aac9-0f4fcddea0a7 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 204 len: 0 microversion: 2.1 time: 0.134976 Jun 30 16:00:34.585014 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 498/998] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:00:34 2022] DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:00:34.593818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:34.594409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:34.600718 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.601161 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.601900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:34.602306 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:34.744629 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:34.752723 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-809deebf-d4fb-4adb-aa54-d77ca5d0209a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1682 microversion: 2.1 time: 0.163148 Jun 30 16:00:34.753346 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 501/999] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:34 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:35.774772 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:35.775947 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:35.786922 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:35.787666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:35.788974 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:35.789694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:35.948462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:35.956121 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-05c744ca-279f-4576-b27f-4f195626447e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1682 microversion: 2.1 time: 0.188582 Jun 30 16:00:35.956715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 499/1000] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:35 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:36.974104 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:36.974851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:36.981871 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:36.982328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:36.983097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:36.983533 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:37.057640 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:37.065564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9a899b98-01f6-4047-b2eb-d15de6bafb89 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 200 len: 1615 microversion: 2.1 time: 0.095535 Jun 30 16:00:37.066346 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 502/1001] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:36 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:37.108143 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-bff4a98a-5ba0-4385-b12b-6d0bcd1fdb3e req-f60e0129-4f59-44b4-8584-c4e7b5ccbbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68450f6e-540e-4501-8cfd-8d4e0073edbf", "name": "network-vif-deleted", "tag": "457adecf-9d56-4af5-b80a-210abd6a1658"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:37.119039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-bff4a98a-5ba0-4385-b12b-6d0bcd1fdb3e req-f60e0129-4f59-44b4-8584-c4e7b5ccbbe4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:37.119447 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-bff4a98a-5ba0-4385-b12b-6d0bcd1fdb3e req-f60e0129-4f59-44b4-8584-c4e7b5ccbbe4 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:37.135007 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-bff4a98a-5ba0-4385-b12b-6d0bcd1fdb3e req-f60e0129-4f59-44b4-8584-c4e7b5ccbbe4 service nova] Creating event network-vif-deleted:457adecf-9d56-4af5-b80a-210abd6a1658 for instance 68450f6e-540e-4501-8cfd-8d4e0073edbf on hv-cinder-79760 Jun 30 16:00:37.140350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-bff4a98a-5ba0-4385-b12b-6d0bcd1fdb3e req-f60e0129-4f59-44b4-8584-c4e7b5ccbbe4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036121 Jun 30 16:00:37.141991 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 500/1002] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:38.082989 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:38.083612 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:38.090467 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:38.091032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:38.092143 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:38.092583 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:38.107708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf HTTP/1.1 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:00:38.109664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:00:38.111319 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '68450f6e-540e-4501-8cfd-8d4e0073edbf'} Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:38.112800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:00:38.114154 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:38.115264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:38.115264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-37e5b52e-9f11-4713-a2f1-1753c7f6e933 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 404 len: 111 microversion: 2.1 time: 0.032224 Jun 30 16:00:38.115264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 503/1003] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:38 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:00:38.121911 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-34a49283-9d3d-44df-a8ab-691aa249e6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '.version_select at 0x7fbbdee84c10>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:38.141491 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-34a49283-9d3d-44df-a8ab-691aa249e6e5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385647714" status: 202 len: 0 microversion: 2.1 time: 0.024367 Jun 30 16:00:38.142049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 501/1004] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 16:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385647714 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:00:38.787094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-24a27507-41b2-4130-b264-cf952178ebc5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: .version_select at 0x7fbbda442820>, body: {"keypair": {"name": "tempest-keypair-1672280519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk/EFnGtnj3Wd5xYz4F9os9Aar7gKjfAjqnBL1C9V4Qa0o6l+hG7G+qvPFodLOEb94pJvuHlzWPQ0ubRDj5/tl7YtNmpru0KwL8V4aiCRRIbiLCJjI5iGWDE3lfk7R+kA=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:38.801334 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-24a27507-41b2-4130-b264-cf952178ebc5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:00:38.805137 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-24a27507-41b2-4130-b264-cf952178ebc5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:00:38.829653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-24a27507-41b2-4130-b264-cf952178ebc5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046490 Jun 30 16:00:38.830247 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 504/1005] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 16:00:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:40.112311 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-940879517", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "651f519d-cbb7-4456-8e55-c8e614147ace"}], "security_groups": [{"name": "tempest-securitygroup--1460624160"}], "key_name": "tempest-keypair-1672280519", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:40.221046 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] validate_networks() for [('651f519d-cbb7-4456-8e55-c8e614147ace', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:00:40.599588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:00:40.600090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:00:40.600540 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:00:40.600992 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:00:40.601436 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:00:40.611132 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:40.611587 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:40.612424 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:40.612867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:40.630364 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:00:40.634413 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:00:40.647715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:00:40.650138 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:00:40.701497 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-02926baf-5468-41cd-8bbb-937f9a65c00f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.594209 Jun 30 16:00:40.702359 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 502/1006] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 16:00:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:00:40.712675 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ef8025d4-d4e2-4e9c-821f-26d41c510445 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:40.713351 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ef8025d4-d4e2-4e9c-821f-26d41c510445 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:40.770869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ef8025d4-d4e2-4e9c-821f-26d41c510445 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:40.779214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ef8025d4-d4e2-4e9c-821f-26d41c510445 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1241 microversion: 2.1 time: 0.070985 Jun 30 16:00:40.779803 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 505/1007] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:40 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:41.798467 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:41.799151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:41.805560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:41.806001 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:41.806729 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:41.807161 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:41.885534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:41.893654 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-86cd319e-4987-4862-aa6e-e17f0b948cf5 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1299 microversion: 2.1 time: 0.099640 Jun 30 16:00:41.894740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 503/1008] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:41 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:42.915519 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:42.916304 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:42.929665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:42.930217 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:42.931271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:42.931680 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:43.133645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:43.141717 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c2c2462e-a47c-46d0-950b-cf64e93e63a1 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.230837 Jun 30 16:00:43.142289 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 506/1009] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:42 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:43.172512 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-e39304e2-b5fa-411e-8cc3-d47fe9f54204 req-941f2ea5-d6a7-4211-b889-6ebc7e54a286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1da3fc-6a87-4e21-865a-79a1a853eb9b", "tag": "d3a186d9-063f-442f-b269-15fdcca1a851"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:43.190166 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e39304e2-b5fa-411e-8cc3-d47fe9f54204 req-941f2ea5-d6a7-4211-b889-6ebc7e54a286 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:43.190923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e39304e2-b5fa-411e-8cc3-d47fe9f54204 req-941f2ea5-d6a7-4211-b889-6ebc7e54a286 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:43.202520 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-e39304e2-b5fa-411e-8cc3-d47fe9f54204 req-941f2ea5-d6a7-4211-b889-6ebc7e54a286 service nova] Creating event network-changed:d3a186d9-063f-442f-b269-15fdcca1a851 for instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b on hv-cinder-79760 Jun 30 16:00:43.207659 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-e39304e2-b5fa-411e-8cc3-d47fe9f54204 req-941f2ea5-d6a7-4211-b889-6ebc7e54a286 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039570 Jun 30 16:00:43.208346 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 504/1010] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:44.162835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:44.163829 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:44.174996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:44.175883 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:44.176730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:44.177158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:44.306886 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:44.314472 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7b889307-555f-4380-b4d1-304ff5071d4f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.158223 Jun 30 16:00:44.315031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 507/1011] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:44 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:45.332155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:45.332876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:45.339637 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:45.340211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:45.341141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:45.341576 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:45.771031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:45.778952 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-44ff5d72-6be4-48cb-a9bb-ced7ec0aec73 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.451711 Jun 30 16:00:45.779482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 505/1012] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:45 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:46.108184 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:46.108709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:46.110651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-e8acc8b1-25fb-4a32-957a-53910096dbad req-9bdcab5a-fbb2-47f2-a442-f1f2be452a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3748b-5b67-4851-97d3-890a110f7e44", "tag": "c8d9a561-eeef-41e9-9ddd-baddd7460f2f"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:46.115574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.116031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.117474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.117903 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.119524 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e8acc8b1-25fb-4a32-957a-53910096dbad req-9bdcab5a-fbb2-47f2-a442-f1f2be452a72 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.120084 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e8acc8b1-25fb-4a32-957a-53910096dbad req-9bdcab5a-fbb2-47f2-a442-f1f2be452a72 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.131759 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-e8acc8b1-25fb-4a32-957a-53910096dbad req-9bdcab5a-fbb2-47f2-a442-f1f2be452a72 service nova] Creating event network-changed:c8d9a561-eeef-41e9-9ddd-baddd7460f2f for instance bdb3748b-5b67-4851-97d3-890a110f7e44 on hv-cinder-79760 Jun 30 16:00:46.136915 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-e8acc8b1-25fb-4a32-957a-53910096dbad req-9bdcab5a-fbb2-47f2-a442-f1f2be452a72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030179 Jun 30 16:00:46.137639 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 506/1013] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:46.149020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:00:46.235869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-99c5d19b-aeff-4542-a741-fe293705ef6f tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 204 len: 0 microversion: 2.1 time: 0.131309 Jun 30 16:00:46.237175 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 508/1014] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:00:46 2022] DELETE /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:00:46.246172 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:46.246864 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:46.253950 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.254446 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.255207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.255633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.689038 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:46.696958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-919e20b0-ff3f-40a8-bbdb-a1633a97fc2b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1575 microversion: 2.1 time: 0.455089 Jun 30 16:00:46.697530 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 507/1015] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:46 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1575 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:46.796843 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:46.797804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:46.804635 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.805084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.805838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:46.806268 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:46.942255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:46.950096 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f0744d11-108b-49cd-86d4-d982da95c429 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.157729 Jun 30 16:00:46.950656 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 509/1016] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:46 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:47.717518 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:47.718141 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:47.728124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:47.728670 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:47.729767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:47.730381 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:47.868023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:47.876012 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ccf7e240-10df-46a0-9cba-bc64412ed71b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1575 microversion: 2.1 time: 0.164948 Jun 30 16:00:47.876588 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 508/1017] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:47 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:47.968026 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:47.968653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:47.976158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:47.976624 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:47.977377 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:47.977805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:48.287800 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:48.295840 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-1bf5c04d-f90c-43fe-953e-bee9ab689f6b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.332106 Jun 30 16:00:48.296735 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 510/1018] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:47 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:48.448079 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-76512ff3-750e-4327-93cf-eed490df58fd req-8eb1e6ea-2b24-4d91-81fd-366a113a4ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1da3fc-6a87-4e21-865a-79a1a853eb9b", "name": "network-vif-plugged", "status": "completed", "tag": "d3a186d9-063f-442f-b269-15fdcca1a851"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:48.457078 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-76512ff3-750e-4327-93cf-eed490df58fd req-8eb1e6ea-2b24-4d91-81fd-366a113a4ad0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:48.457694 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-76512ff3-750e-4327-93cf-eed490df58fd req-8eb1e6ea-2b24-4d91-81fd-366a113a4ad0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:48.473425 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-76512ff3-750e-4327-93cf-eed490df58fd req-8eb1e6ea-2b24-4d91-81fd-366a113a4ad0 service nova] Creating event network-vif-plugged:d3a186d9-063f-442f-b269-15fdcca1a851 for instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b on hv-cinder-79760 Jun 30 16:00:48.478906 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-76512ff3-750e-4327-93cf-eed490df58fd req-8eb1e6ea-2b24-4d91-81fd-366a113a4ad0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Jun 30 16:00:48.479854 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 509/1019] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:48.783766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-61b4af3f-308d-4e30-a898-0a660d3a2408 req-2601217b-8db1-41c2-a7a0-8a0825c6eae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3748b-5b67-4851-97d3-890a110f7e44", "name": "network-vif-deleted", "tag": "c8d9a561-eeef-41e9-9ddd-baddd7460f2f"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:48.794245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-61b4af3f-308d-4e30-a898-0a660d3a2408 req-2601217b-8db1-41c2-a7a0-8a0825c6eae3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:48.794691 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-61b4af3f-308d-4e30-a898-0a660d3a2408 req-2601217b-8db1-41c2-a7a0-8a0825c6eae3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:48.805810 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-61b4af3f-308d-4e30-a898-0a660d3a2408 req-2601217b-8db1-41c2-a7a0-8a0825c6eae3 service nova] Creating event network-vif-deleted:c8d9a561-eeef-41e9-9ddd-baddd7460f2f for instance bdb3748b-5b67-4851-97d3-890a110f7e44 on hv-cinder-79760 Jun 30 16:00:48.810804 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-61b4af3f-308d-4e30-a898-0a660d3a2408 req-2601217b-8db1-41c2-a7a0-8a0825c6eae3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jun 30 16:00:48.811682 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 511/1020] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:48.897948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:48.899070 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:48.911549 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:48.912018 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:48.912818 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:48.913285 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:48.977265 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:48.980860 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:48.985386 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a4a2085f-17ce-478c-8a45-af3fee589fa5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1389 microversion: 2.1 time: 0.094345 Jun 30 16:00:48.985949 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 510/1021] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:48 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:49.185230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:00:49.185758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 16:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:00:49.316873 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:49.317812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:49.328135 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:49.328731 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:49.329537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:49.330066 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:49.467420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:49.476664 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5028e22b-9c8d-4200-a770-46320ee1cc6a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1367 microversion: 2.1 time: 0.166727 Jun 30 16:00:49.477522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 512/1022] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:49 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:50.006653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:50.007570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:50.018527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.019155 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.020198 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.020642 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.053695 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.054134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.054570 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lazy-loading 'fault' on Instance uuid bdb3748b-5b67-4851-97d3-890a110f7e44 {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:00:50.098847 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:50.106968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3fb23233-345f-4123-85d3-49e85f19d732 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 200 len: 1229 microversion: 2.1 time: 0.107121 Jun 30 16:00:50.107534 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 511/1023] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:49 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:50.494744 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:50.495425 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:50.503114 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.503614 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.504559 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.504996 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.652355 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:50.657414 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:50.663483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ab4b1e7d-8eaf-48a2-aeec-83a1a1435dea tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1558 microversion: 2.1 time: 0.173067 Jun 30 16:00:50.664277 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 513/1024] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:50 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:50.687215 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:50.687802 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:50.690561 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:50.691499 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:50.701021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.701767 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.702977 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:50.703684 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:50.790715 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-822a940d-2805-4dcf-9089-db05d45b28ca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109420 Jun 30 16:00:50.791502 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 512/1025] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 16:00:50 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:51.124867 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:51.125474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: bdb3748b-5b67-4851-97d3-890a110f7e44] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:51.127498 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:51.134147 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:51.134675 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:51.135492 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:51.135918 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:51.151272 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] HTTP exception thrown: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Request method failure captured: Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 HTTP/1.1 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbQt0zL5lXZW2DbuSy2IZnRjuRdhsJERDzrq80UPedd-AJJZLI-SJ77AMLMc38Ss-UsmHmn1h_RQ4dBCmKOihgLU5wkyoMp4rNAqvpUI9OFRWMzj-NzPUhpiksO1i8GRcujRfNc0L9wdYjf2VnJcxZdIZlSv-0hyYxNw7umFgn0BD8 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:00:51.152959 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_affc1e688df04803bb823ccadf904c0a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 2de768b55f9a495295113de2ce1279e5 Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. Jun 30 16:00:51.154465 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'bdb3748b-5b67-4851-97d3-890a110f7e44'} Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:51.155554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. Jun 30 16:00:51.157047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:51.158818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Returning 404 to user: Instance bdb3748b-5b67-4851-97d3-890a110f7e44 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:51.158818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-cdd99747-fee5-4a8c-a790-e0c6c328b029 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44" status: 404 len: 111 microversion: 2.1 time: 0.033968 Jun 30 16:00:51.158818 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 514/1026] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:51 2022] GET /compute/v2.1/servers/bdb3748b-5b67-4851-97d3-890a110f7e44 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:00:51.761439 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-e670e489-772c-497c-bbe5-cc48ec7d3d6e req-64b0a4ca-6e6b-4864-98f6-e50e139d7b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1da3fc-6a87-4e21-865a-79a1a853eb9b", "tag": "d3a186d9-063f-442f-b269-15fdcca1a851"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:51.770444 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e670e489-772c-497c-bbe5-cc48ec7d3d6e req-64b0a4ca-6e6b-4864-98f6-e50e139d7b1c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:51.770890 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-e670e489-772c-497c-bbe5-cc48ec7d3d6e req-64b0a4ca-6e6b-4864-98f6-e50e139d7b1c service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:51.782731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-e670e489-772c-497c-bbe5-cc48ec7d3d6e req-64b0a4ca-6e6b-4864-98f6-e50e139d7b1c service nova] Creating event network-changed:d3a186d9-063f-442f-b269-15fdcca1a851 for instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b on hv-cinder-79760 Jun 30 16:00:51.787808 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-e670e489-772c-497c-bbe5-cc48ec7d3d6e req-64b0a4ca-6e6b-4864-98f6-e50e139d7b1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Jun 30 16:00:51.788618 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 513/1027] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:54.305071 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:54.305574 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:54.312595 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:54.313395 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:54.314158 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:54.314295 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-25142438-395a-4b29-8b99-94cb8f2567b8 req-d6e40027-7f40-41c3-843e-a90855548be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd27b33a-1ad4-49eb-82cb-9d4902ea8e65", "tag": "d7dfc636-d3ea-4da0-b88f-321be177f4c0"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:54.315211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:54.323186 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-25142438-395a-4b29-8b99-94cb8f2567b8 req-d6e40027-7f40-41c3-843e-a90855548be3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:54.323633 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-25142438-395a-4b29-8b99-94cb8f2567b8 req-d6e40027-7f40-41c3-843e-a90855548be3 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:54.335664 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-25142438-395a-4b29-8b99-94cb8f2567b8 req-d6e40027-7f40-41c3-843e-a90855548be3 service nova] Creating event network-changed:d7dfc636-d3ea-4da0-b88f-321be177f4c0 for instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 on hv-cinder-79760 Jun 30 16:00:54.340836 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-25142438-395a-4b29-8b99-94cb8f2567b8 req-d6e40027-7f40-41c3-843e-a90855548be3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030507 Jun 30 16:00:54.341644 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 514/1028] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:54.342826 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:00:54.436549 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2b087881-174c-4189-a62e-6f58c9a04ff3 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 204 len: 0 microversion: 2.1 time: 0.135003 Jun 30 16:00:54.437516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 515/1029] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:00:54 2022] DELETE /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:00:54.453227 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:54.453959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:54.465262 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:54.465726 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:54.466514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:54.466958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:54.629253 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:54.637368 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-29cc723f-1a52-4c5c-81c6-cc52beed8623 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1577 microversion: 2.1 time: 0.191553 Jun 30 16:00:54.637945 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 515/1030] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:54 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:55.659743 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:55.660872 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:55.667879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:55.668367 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:55.671658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:55.671658 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:55.877944 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:55.885895 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-e198a34e-147e-4d5c-a5c7-11f12b863a5a tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1577 microversion: 2.1 time: 0.233288 Jun 30 16:00:55.886672 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 516/1031] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:55 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:56.435731 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-1690facd-3c4c-476a-99bd-e47d43c7166c req-4fe98b54-9329-4db6-adc2-1d2b8e5cc14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd27b33a-1ad4-49eb-82cb-9d4902ea8e65", "name": "network-vif-deleted", "tag": "d7dfc636-d3ea-4da0-b88f-321be177f4c0"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:00:56.445430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1690facd-3c4c-476a-99bd-e47d43c7166c req-4fe98b54-9329-4db6-adc2-1d2b8e5cc14e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:56.445866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-1690facd-3c4c-476a-99bd-e47d43c7166c req-4fe98b54-9329-4db6-adc2-1d2b8e5cc14e service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:56.457463 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-1690facd-3c4c-476a-99bd-e47d43c7166c req-4fe98b54-9329-4db6-adc2-1d2b8e5cc14e service nova] Creating event network-vif-deleted:d7dfc636-d3ea-4da0-b88f-321be177f4c0 for instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 on hv-cinder-79760 Jun 30 16:00:56.465020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-1690facd-3c4c-476a-99bd-e47d43c7166c req-4fe98b54-9329-4db6-adc2-1d2b8e5cc14e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Jun 30 16:00:56.465609 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 516/1032] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:00:56.903869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:56.904483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:56.911805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:56.912216 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:56.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:56.913399 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:56.944654 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:56.945085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:56.945522 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lazy-loading 'fault' on Instance uuid cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:00:56.991446 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de768b55f9a495295113de2ce1279e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'affc1e688df04803bb823ccadf904c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:00:56.999593 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a37bb42e-35c3-4b68-b7ba-57270cc03972 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 200 len: 1230 microversion: 2.1 time: 0.100199 Jun 30 16:00:57.010181 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 517/1033] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:56 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:00:58.023931 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:58.025104 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: cd27b33a-1ad4-49eb-82cb-9d4902ea8e65] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:58.035841 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.036254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.037026 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.037462 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.051542 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] HTTP exception thrown: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Request method failure captured: Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 HTTP/1.1 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcbQt0zL5lXZW2DbuSy2IZnRjuRdhsJERDzrq80UPedd-AJJZLI-SJ77AMLMc38Ss-UsmHmn1h_RQ4dBCmKOihgLU5wkyoMp4rNAqvpUI9OFRWMzj-NzPUhpiksO1i8GRcujRfNc0L9wdYjf2VnJcxZdIZlSv-0hyYxNw7umFgn0BD8 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:00:58.053274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_affc1e688df04803bb823ccadf904c0a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2de768b55f9a495295113de2ce1279e5 Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. Jun 30 16:00:58.054867 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'cd27b33a-1ad4-49eb-82cb-9d4902ea8e65'} Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:58.055861 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. Jun 30 16:00:58.057482 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.059016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Returning 404 to user: Instance cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:58.059016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-fbc511a3-7f4a-40e4-99dc-98d12e27e4bc tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65" status: 404 len: 111 microversion: 2.1 time: 0.038821 Jun 30 16:00:58.059016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 517/1034] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:58 2022] GET /compute/v2.1/servers/cd27b33a-1ad4-49eb-82cb-9d4902ea8e65 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:00:58.796001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:58.796560 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:58.799060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:58.804626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.805072 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.805835 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.806264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.821100 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] HTTP exception thrown: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Request method failure captured: Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a HTTP/1.1 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcbQt0zL5lXZW2DbuSy2IZnRjuRdhsJERDzrq80UPedd-AJJZLI-SJ77AMLMc38Ss-UsmHmn1h_RQ4dBCmKOihgLU5wkyoMp4rNAqvpUI9OFRWMzj-NzPUhpiksO1i8GRcujRfNc0L9wdYjf2VnJcxZdIZlSv-0hyYxNw7umFgn0BD8 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:00:58.822752 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_affc1e688df04803bb823ccadf904c0a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 2de768b55f9a495295113de2ce1279e5 Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.824433 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '1b17294c-3c9b-481a-b90b-36b12e5d2c5a'} Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:58.825352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.826879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.828453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Returning 404 to user: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:58.828453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-81253365-2458-48f8-bbca-ef27faf524e5 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 404 len: 111 microversion: 2.1 time: 0.032194 Jun 30 16:00:58.828453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 518/1035] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:00:58 2022] DELETE /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:00:58.836791 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:00:58.837410 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] [instance: 1b17294c-3c9b-481a-b90b-36b12e5d2c5a] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:00:58.839384 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:00:58.845243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.845690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.846483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:00:58.846924 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:00:58.862096 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] HTTP exception thrown: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Request method failure captured: Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a HTTP/1.1 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcbQt0zL5lXZW2DbuSy2IZnRjuRdhsJERDzrq80UPedd-AJJZLI-SJ77AMLMc38Ss-UsmHmn1h_RQ4dBCmKOihgLU5wkyoMp4rNAqvpUI9OFRWMzj-NzPUhpiksO1i8GRcujRfNc0L9wdYjf2VnJcxZdIZlSv-0hyYxNw7umFgn0BD8 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:00:58.863666 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_affc1e688df04803bb823ccadf904c0a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/affc1e688df04803bb823ccadf904c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: affc1e688df04803bb823ccadf904c0a Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-TestVolumeBootPattern-540202404 Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 2de768b55f9a495295113de2ce1279e5 Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-TestVolumeBootPattern-540202404-project Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.865409 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '1b17294c-3c9b-481a-b90b-36b12e5d2c5a'} Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:00:58.866193 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. Jun 30 16:00:58.867667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:00:58.868891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Returning 404 to user: Instance 1b17294c-3c9b-481a-b90b-36b12e5d2c5a could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:00:58.868891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-bc63e0be-2c34-4c88-9688-c31b0af25863 tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a" status: 404 len: 111 microversion: 2.1 time: 0.036234 Jun 30 16:00:58.868891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 518/1036] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:00:58 2022] GET /compute/v2.1/servers/1b17294c-3c9b-481a-b90b-36b12e5d2c5a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:01:00.196874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a50b0157-5e1a-483e-8020-2be0aff4102b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] Calling method '.version_select at 0x7fbbda470430>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:00.216591 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a50b0157-5e1a-483e-8020-2be0aff4102b tempest-TestVolumeBootPattern-540202404 tempest-TestVolumeBootPattern-540202404-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-457533439" status: 202 len: 0 microversion: 2.1 time: 0.023615 Jun 30 16:01:00.228608 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 519/1037] 10.222.0.50 () {58 vars in 1259 bytes} [Thu Jun 30 16:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-457533439 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:01:07.999045 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:08.000123 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-0fa27920-2a87-4694-8280-b2766384967d req-20fbdd90-2161-41f0-adc1-4593a655fc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:08.002110 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:08.013289 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:08.014039 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:08.014978 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:08.015214 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-0fa27920-2a87-4694-8280-b2766384967d req-20fbdd90-2161-41f0-adc1-4593a655fc42 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:08.015724 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-0fa27920-2a87-4694-8280-b2766384967d req-20fbdd90-2161-41f0-adc1-4593a655fc42 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:08.015912 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:08.030946 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-0fa27920-2a87-4694-8280-b2766384967d req-20fbdd90-2161-41f0-adc1-4593a655fc42 service nova] Creating event network-changed:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 16:01:08.037817 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-0fa27920-2a87-4694-8280-b2766384967d req-20fbdd90-2161-41f0-adc1-4593a655fc42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047316 Jun 30 16:01:08.044429 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 520/1038] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:08.048382 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:01:08.156699 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cbcbe490-4747-44f3-97fa-fda6171d77d9 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 204 len: 0 microversion: 2.1 time: 0.168263 Jun 30 16:01:08.157862 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 519/1039] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:01:07 2022] DELETE /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:01:08.171566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:08.173340 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:08.180910 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:08.181779 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:08.182755 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:08.183941 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:08.358009 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:08.365840 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ec77615f-f5e4-4a27-b995-78153d6d81f0 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.200938 Jun 30 16:01:08.366513 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 521/1040] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:08 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:01:09.385211 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:09.385971 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:09.393430 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:09.393976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:09.394750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:09.395187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:09.574251 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:09.582545 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d7e6ce3a-f386-4392-9c93-e588ac2d22df tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1570 microversion: 2.1 time: 0.201776 Jun 30 16:01:09.583146 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 520/1041] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:09 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:10.496970 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-e152860c-d7df-4dde-821d-d0089d279ca3 req-af930f48-1de2-461d-b450-0ba28ee0cb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f440ea9-dfd3-4b81-8da6-e1fc3c802686", "name": "network-vif-deleted", "tag": "fd651afa-3e4f-45e3-993b-8ca20eadb294"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:10.506554 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-e152860c-d7df-4dde-821d-d0089d279ca3 req-af930f48-1de2-461d-b450-0ba28ee0cb3a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:10.506988 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-e152860c-d7df-4dde-821d-d0089d279ca3 req-af930f48-1de2-461d-b450-0ba28ee0cb3a service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:10.518643 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-e152860c-d7df-4dde-821d-d0089d279ca3 req-af930f48-1de2-461d-b450-0ba28ee0cb3a service nova] Creating event network-vif-deleted:fd651afa-3e4f-45e3-993b-8ca20eadb294 for instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 on hv-cinder-79760 Jun 30 16:01:10.523495 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-e152860c-d7df-4dde-821d-d0089d279ca3 req-af930f48-1de2-461d-b450-0ba28ee0cb3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Jun 30 16:01:10.524325 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 522/1042] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:10.600468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:10.601124 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:10.607797 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:10.608274 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:10.609029 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:10.609468 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:10.671259 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e1730c8601c4334913b13e85e76e8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b94cd4341d64c409783fecfa81763e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:10.679065 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e0ffa8d9-1ac6-438f-ade0-a66177884967 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 200 len: 1219 microversion: 2.1 time: 0.082662 Jun 30 16:01:10.679634 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 521/1043] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:10 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:11.702001 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:11.703122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] [instance: 9f440ea9-dfd3-4b81-8da6-e1fc3c802686] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:11.712049 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:11.712516 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:11.713268 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:11.713692 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:11.727661 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] HTTP exception thrown: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Request method failure captured: Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 HTTP/1.1 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcekXHHdNyhHLlAdxZPoMrG2nJBrl-lYgTDfEzSxpRbYkoGjjqI0lO05wGc9OR4iNettvSxBQrBzajtmnhxnaAwFW8NtKTB8Wfz6aOaX8Bj_i-DagrNzIJ_5VRbXxIzuScFVH-mwHAFgjDEKay10liQrsFpBSx85jmi8_g1joUAMGCA Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 7b94cd4341d64c409783fecfa81763e1 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-TestShelveInstance-1247658874 Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:01:11.729348 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b94cd4341d64c409783fecfa81763e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b94cd4341d64c409783fecfa81763e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b94cd4341d64c409783fecfa81763e1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b94cd4341d64c409783fecfa81763e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-TestShelveInstance-1247658874 Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 7b94cd4341d64c409783fecfa81763e1 Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-TestShelveInstance-1247658874 Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-TestShelveInstance-1247658874-project Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 6e1730c8601c4334913b13e85e76e8d1 Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-TestShelveInstance-1247658874-project Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. Jun 30 16:01:11.731019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '9f440ea9-dfd3-4b81-8da6-e1fc3c802686'} Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:01:11.732060 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. Jun 30 16:01:11.733727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:11.735309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Returning 404 to user: Instance 9f440ea9-dfd3-4b81-8da6-e1fc3c802686 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:01:11.735309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9a26a082-694a-40f8-ab9b-d7df56b7e093 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686" status: 404 len: 111 microversion: 2.1 time: 0.036728 Jun 30 16:01:11.735309 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 523/1044] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:11 2022] GET /compute/v2.1/servers/9f440ea9-dfd3-4b81-8da6-e1fc3c802686 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:01:11.898975 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d14e24ad-994d-4e1e-998a-e12730a107f5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] Calling method '.version_select at 0x7fbbda55a9d0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:11.922605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d14e24ad-994d-4e1e-998a-e12730a107f5 tempest-TestShelveInstance-1247658874 tempest-TestShelveInstance-1247658874-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-317335609" status: 202 len: 0 microversion: 2.1 time: 0.027513 Jun 30 16:01:11.926948 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 522/1045] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-317335609 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:01:27.656566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:27.657194 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:27.659233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:27.659892 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:27.665727 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:27.666172 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:27.666939 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:27.667373 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:27.692605 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6123f223-e4f5-4c4a-a1af-74c116048a33 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/ips" status: 200 len: 151 microversion: 2.1 time: 0.042719 Jun 30 16:01:27.693166 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 524/1046] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 16:01:27 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:29.024202 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:29.025023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:29.030786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:29.032423 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:29.041333 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:29.041786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:29.042620 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:29.043057 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:29.302170 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7ce65b26-30c2-4289-847a-7f0e8eda89a8 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279835 Jun 30 16:01:29.302780 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 523/1047] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 16:01:29 2022] POST /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:35.818653 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:35.819729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:35.827352 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:35.827827 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:35.828625 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:35.829053 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:35.914900 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: POST /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments HTTP/1.1 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 74 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:01:35.916562 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {"volumeAttachment": {"volumeId": "a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a"}} Jun 30 16:01:35.918286 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'server_id': 'ea1da3fc-6a87-4e21-865a-79a1a853eb9b', 'body': {'volumeAttachment': {'volumeId': 'a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a'}}} Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:35.919155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:35.920488 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 400 to user: Invalid volume: volume a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a is already attached to instances: ea1da3fc-6a87-4e21-865a-79a1a853eb9b {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f2b5f67a-2ef2-4914-b063-0e51fa734f06 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103477 Jun 30 16:01:35.921781 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 525/1048] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 16:01:35 2022] POST /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:01:35.981254 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:35.981803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:35.988428 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:35.988882 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:35.989668 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:35.990108 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:36.081420 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.objects.instance [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lazy-loading 'services' on Instance uuid ea1da3fc-6a87-4e21-865a-79a1a853eb9b {{(pid=129450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:01:36.156021 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-280f48e3-3ee9-42ff-b456-e41605c4371a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments/a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a" status: 202 len: 0 microversion: 2.1 time: 0.179375 Jun 30 16:01:36.156607 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 524/1049] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 16:01:35 2022] DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments/a4d97b7f-70ff-4f29-9fb6-63c88c51ff9a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:01:36.165151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:36.166134 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:36.173879 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:36.174485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:36.175384 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:36.175823 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:36.209715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c425f99c-57b8-4390-8818-c446971eda28 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048626 Jun 30 16:01:36.210306 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 526/1050] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:01:36 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:37.227207 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:37.228327 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:37.235232 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.235702 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.236490 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.236956 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.266959 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-849e6136-e2ec-4dbd-a1bf-78ef3aa26d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046671 Jun 30 16:01:37.267514 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 525/1051] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:01:37 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:01:37.325421 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:37.325985 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:37.332877 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.333327 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.334128 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.334565 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.360530 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Going to try to terminate instance {{(pid=129449) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:01:37.444628 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f98f00e1-087c-4c45-b413-790f6c829dca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 204 len: 0 microversion: 2.1 time: 0.122675 Jun 30 16:01:37.445271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 527/1052] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:01:37 2022] DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:01:37.454316 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:37.454958 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:37.461128 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.461600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.462361 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:37.462790 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:37.609222 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:37.617157 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-21aa869c-ed66-4bd1-86bd-524b1c591c67 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1683 microversion: 2.1 time: 0.167478 Jun 30 16:01:37.617783 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 526/1053] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:37 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:38.648485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:38.649543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:38.660734 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:38.661483 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:38.662824 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:38.663257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:38.797986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:38.809671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-886bf236-d751-4ed8-ab35-888ac01a2558 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1683 microversion: 2.1 time: 0.168292 Jun 30 16:01:38.810420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 528/1054] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:38 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:39.833208 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:39.834086 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:39.845812 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:39.846289 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:39.847142 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:39.847577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:39.934645 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:39.942655 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ec1661fc-426b-493e-9860-8975980baefe tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 200 len: 1615 microversion: 2.1 time: 0.116669 Jun 30 16:01:39.943257 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 529/1055] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:39 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:40.053224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-6673c2b6-e63c-4bd5-acb0-8a5c3be3149b req-8887057c-4745-409b-a4b2-43b724a29a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1da3fc-6a87-4e21-865a-79a1a853eb9b", "name": "network-vif-deleted", "tag": "d3a186d9-063f-442f-b269-15fdcca1a851"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:40.061622 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-6673c2b6-e63c-4bd5-acb0-8a5c3be3149b req-8887057c-4745-409b-a4b2-43b724a29a1f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:40.062278 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-6673c2b6-e63c-4bd5-acb0-8a5c3be3149b req-8887057c-4745-409b-a4b2-43b724a29a1f service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:40.074572 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-6673c2b6-e63c-4bd5-acb0-8a5c3be3149b req-8887057c-4745-409b-a4b2-43b724a29a1f service nova] Creating event network-vif-deleted:d3a186d9-063f-442f-b269-15fdcca1a851 for instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b on hv-cinder-79760 Jun 30 16:01:40.081682 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-6673c2b6-e63c-4bd5-acb0-8a5c3be3149b req-8887057c-4745-409b-a4b2-43b724a29a1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280091 Jun 30 16:01:40.082287 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 527/1056] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:40.969057 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:40.970011 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:40.978856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:40.979308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:40.980101 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:40.980529 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:40.994121 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b HTTP/1.1 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:01:40.995766 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:01:40.997423 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'ea1da3fc-6a87-4e21-865a-79a1a853eb9b'} Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:01:40.998366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:01:41.000020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:01:41.001471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:01:41.001471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-6fa7654f-f033-41be-a949-34cfc6c02aca tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 404 len: 111 microversion: 2.1 time: 0.035193 Jun 30 16:01:41.001471 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 530/1057] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:40 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:01:41.007839 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-d3a6afaa-bcc2-454e-9b57-2624f7b88164 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '.version_select at 0x7fbbda5cc4c0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:41.029505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-d3a6afaa-bcc2-454e-9b57-2624f7b88164 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672280519" status: 202 len: 0 microversion: 2.1 time: 0.026104 Jun 30 16:01:41.030323 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 528/1058] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 16:01:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672280519 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:01:41.667225 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7e073295-d8d4-44a1-9861-2d5f0245fd2c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: .version_select at 0x7fbbda3f98b0>, body: {"keypair": {"name": "tempest-keypair-1239445855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5VtzK3xcxAM3mPud4nCWnO2B6+nNIuzBJln9o5utGufTWrtnuVTfF5Rm/x8JJiBm7ypFeLUEv3y3MkL12gCE7JmmIHMLe54+ocSFer+XvAd8D49GgepmbdfxoTsQeBJQ=="}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:41.681992 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-7e073295-d8d4-44a1-9861-2d5f0245fd2c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:01:41.686259 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.quota [None req-7e073295-d8d4-44a1-9861-2d5f0245fd2c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'key_pairs'} {{(pid=129449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:01:41.713544 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7e073295-d8d4-44a1-9861-2d5f0245fd2c tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049875 Jun 30 16:01:41.714278 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 531/1059] 10.222.0.50 () {60 vars in 1158 bytes} [Thu Jun 30 16:01:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:43.031740 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-713263845", "imageRef": "170eee18-d7e1-4ed4-8e3b-15f4374113e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "651f519d-cbb7-4456-8e55-c8e614147ace"}], "security_groups": [{"name": "tempest-securitygroup--1957490635"}], "key_name": "tempest-keypair-1239445855", "user_data": "}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:43.146049 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.network.neutron [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] validate_networks() for [('651f519d-cbb7-4456-8e55-c8e614147ace', None, None, None, None, None)] {{(pid=129450) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:01:43.548153 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:01:43.548605 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image limits 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:01:43.549077 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Flavor pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:01:43.549485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Image pref 0:0:0 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:01:43.549899 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.virt.hardware [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:01:43.559234 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:43.559675 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:43.560964 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:43.561406 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:43.578891 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:01:43.583031 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.quota [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Getting quotas for user 9ff354a709914b99bee9785b9577781d and project 6c05e9d2132f446a93aba1f27c37b412. Resources: {'instances', 'cores', 'ram'} {{(pid=129450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:01:43.595406 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Going to run 1 instances... {{(pid=129450) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:01:43.597827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='170eee18-d7e1-4ed4-8e3b-15f4374113e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:01:43.645865 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-00159a16-8d1d-40ed-9216-844e7e07a214 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619023 Jun 30 16:01:43.646505 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 529/1060] 10.222.0.50 () {60 vars in 1146 bytes} [Thu Jun 30 16:01:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:01:43.657264 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7e520562-9f3f-4d1d-9464-c224cb80a5d2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:43.657878 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7e520562-9f3f-4d1d-9464-c224cb80a5d2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:43.712067 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-7e520562-9f3f-4d1d-9464-c224cb80a5d2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:43.719108 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7e520562-9f3f-4d1d-9464-c224cb80a5d2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1241 microversion: 2.1 time: 0.066216 Jun 30 16:01:43.719667 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 532/1061] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:43 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:44.737165 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:44.737788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:44.757036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:44.757483 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:44.758543 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:44.759054 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:44.849553 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:44.858020 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-bfceeb9b-3331-4043-ab2a-0d531eef6db6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1311 microversion: 2.1 time: 0.125507 Jun 30 16:01:44.858591 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 530/1062] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:44 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:45.875178 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:45.875967 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:45.883770 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:45.884287 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:45.885074 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:45.885503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:46.102802 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:46.110403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-0b73f2b3-f510-4f1d-88ac-719315265072 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.239409 Jun 30 16:01:46.111033 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 533/1063] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:45 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:46.515897 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-aae8d9c6-4d1d-4873-8a0e-7f69db6ff507 req-f227433a-1e62-4d3c-b421-49abe332a8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ced8e9-2e44-4dc6-9422-5d3b9817d47d", "tag": "91ffd1ab-70d9-4fef-bffb-d4b8898d46ba"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:46.536476 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-aae8d9c6-4d1d-4873-8a0e-7f69db6ff507 req-f227433a-1e62-4d3c-b421-49abe332a8d0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:46.536923 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-aae8d9c6-4d1d-4873-8a0e-7f69db6ff507 req-f227433a-1e62-4d3c-b421-49abe332a8d0 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:46.550750 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-aae8d9c6-4d1d-4873-8a0e-7f69db6ff507 req-f227433a-1e62-4d3c-b421-49abe332a8d0 service nova] Creating event network-changed:91ffd1ab-70d9-4fef-bffb-d4b8898d46ba for instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d on hv-cinder-79760 Jun 30 16:01:46.556437 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-aae8d9c6-4d1d-4873-8a0e-7f69db6ff507 req-f227433a-1e62-4d3c-b421-49abe332a8d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049255 Jun 30 16:01:46.557279 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 531/1064] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:47.132085 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:47.132931 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:47.144081 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:47.144856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:47.146122 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:47.146847 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:47.292869 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:47.300445 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f2405e23-32ee-4fa5-973e-e01a722c1be2 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.175056 Jun 30 16:01:47.300988 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 534/1065] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:47 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:48.319448 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:48.320309 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:48.327429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:48.327876 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:48.328681 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:48.329114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:48.539687 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:48.548925 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ab167ef8-9c76-4176-b233-b008f22f59d6 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.233714 Jun 30 16:01:48.549474 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 532/1066] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:48 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:49.570704 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:49.571683 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:49.582302 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:49.583040 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:49.584409 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:49.585093 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:49.724669 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:49.733878 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-693ffe7e-bfd3-4423-9a85-4ce5b5b2926b tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.170096 Jun 30 16:01:49.734448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 535/1067] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:49 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:50.751090 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:50.752083 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:50.759581 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:50.760243 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:50.763016 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:50.763662 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:50.839874 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [req-f0e5b452-ec3e-4e5d-a57a-acc9a0507da4 req-0532266c-7086-45e2-b81c-70644e68a432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ced8e9-2e44-4dc6-9422-5d3b9817d47d", "name": "network-vif-plugged", "status": "completed", "tag": "91ffd1ab-70d9-4fef-bffb-d4b8898d46ba"}]} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:50.848412 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f0e5b452-ec3e-4e5d-a57a-acc9a0507da4 req-0532266c-7086-45e2-b81c-70644e68a432 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:50.848977 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [req-f0e5b452-ec3e-4e5d-a57a-acc9a0507da4 req-0532266c-7086-45e2-b81c-70644e68a432 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:50.860250 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.compute.server_external_events [req-f0e5b452-ec3e-4e5d-a57a-acc9a0507da4 req-0532266c-7086-45e2-b81c-70644e68a432 service nova] Creating event network-vif-plugged:91ffd1ab-70d9-4fef-bffb-d4b8898d46ba for instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d on hv-cinder-79760 Jun 30 16:01:50.865543 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [req-f0e5b452-ec3e-4e5d-a57a-acc9a0507da4 req-0532266c-7086-45e2-b81c-70644e68a432 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110244 Jun 30 16:01:50.866213 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 536/1068] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:50.917929 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:50.925963 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-4c801835-c02e-4d42-97f2-a75315302a57 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.179497 Jun 30 16:01:50.926486 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 533/1069] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:50 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:51.948783 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:51.949650 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:51.956649 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:51.957087 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:51.957838 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:51.958263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:52.097572 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:52.105245 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-ba5b1bd2-669e-482b-ad5f-5f1d27278d66 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1367 microversion: 2.1 time: 0.164052 Jun 30 16:01:52.105805 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 537/1070] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:51 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:53.126486 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:53.127485 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:53.138690 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:53.139441 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:53.140756 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:53.141480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:53.278616 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:01:53.286350 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-645a333d-f69a-4e8e-9a46-18469277f114 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1557 microversion: 2.1 time: 0.166546 Jun 30 16:01:53.286887 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 534/1071] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:01:53 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:01:53.302564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:01:53.303084 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:01:53.309834 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:53.310279 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:53.311032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:53.311464 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:53.391328 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-b8440ab3-faf5-44d8-9035-c90193e35821 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092581 Jun 30 16:01:53.391923 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 538/1072] 10.222.0.50 () {58 vars in 1274 bytes} [Thu Jun 30 16:01:53 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:01:54.320716 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-a92d5fc8-f150-4aac-ae1d-687402cdc4a0 req-7a031d73-516f-4143-947b-a376882e5ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ced8e9-2e44-4dc6-9422-5d3b9817d47d", "tag": "91ffd1ab-70d9-4fef-bffb-d4b8898d46ba"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:01:54.324297 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:54.324965 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell0:SELECT=6 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:01:54.331273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-a92d5fc8-f150-4aac-ae1d-687402cdc4a0 req-7a031d73-516f-4143-947b-a376882e5ee2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:01:54.331710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-a92d5fc8-f150-4aac-ae1d-687402cdc4a0 req-7a031d73-516f-4143-947b-a376882e5ee2 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:01:54.343190 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-a92d5fc8-f150-4aac-ae1d-687402cdc4a0 req-7a031d73-516f-4143-947b-a376882e5ee2 service nova] Creating event network-changed:91ffd1ab-70d9-4fef-bffb-d4b8898d46ba for instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d on hv-cinder-79760 Jun 30 16:01:54.348646 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-a92d5fc8-f150-4aac-ae1d-687402cdc4a0 req-7a031d73-516f-4143-947b-a376882e5ee2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Jun 30 16:01:54.349757 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 535/1073] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:26.571917 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell0:SELECT=6 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:26.573715 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:26.574760 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:26.579151 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:26.579669 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:26.588205 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:26.588669 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:26.589417 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:26.589849 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:26.615393 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d80369d0-21d1-46bc-98fd-4f16d9954488 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/ips" status: 200 len: 150 microversion: 2.1 time: 0.044535 Jun 30 16:02:26.615971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 539/1074] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 16:02:26 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:27.958765 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:27.959600 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:27.963903 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d5456b-38c4-4908-8951-18e7fdde3981"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:02:27.965080 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:27.973380 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:27.973830 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:27.974597 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:27.975033 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:28.234477 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7f788987-d83d-4b6e-9153-78b6e11f903e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "POST /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277056 Jun 30 16:02:28.235097 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 536/1075] 10.222.0.50 () {60 vars in 1322 bytes} [Thu Jun 30 16:02:27 2022] POST /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:34.811025 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:34.811553 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:34.818662 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:34.819146 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:34.819889 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:34.820420 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:34.908688 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.objects.instance [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lazy-loading 'services' on Instance uuid a3ced8e9-2e44-4dc6-9422-5d3b9817d47d {{(pid=129449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:02:34.996382 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-7037a29f-a68a-4a2b-9b6b-0301e7e73080 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments/72d5456b-38c4-4908-8951-18e7fdde3981" status: 202 len: 0 microversion: 2.1 time: 0.189094 Jun 30 16:02:34.997230 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 540/1076] 10.222.0.50 () {58 vars in 1415 bytes} [Thu Jun 30 16:02:34 2022] DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments/72d5456b-38c4-4908-8951-18e7fdde3981 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:02:35.006866 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:35.008523 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:35.014957 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:35.015408 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:35.016220 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:35.016653 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:35.047196 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-be423e74-3328-4bea-8aa7-b10c0d3eb8d9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Jun 30 16:02:35.047739 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 537/1077] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:02:35 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:36.063967 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:36.065097 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:36.072083 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.072538 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.073298 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.073729 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.103473 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5171dfdb-509e-4258-9869-9c93ee1a2d7e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046476 Jun 30 16:02:36.104031 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 541/1078] 10.222.0.50 () {58 vars in 1301 bytes} [Thu Jun 30 16:02:36 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:02:36.162539 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:36.163072 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:36.169970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.170414 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.171162 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.171592 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.197273 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Going to try to terminate instance {{(pid=129450) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:02:36.289372 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-3d812e3a-0bf2-48cf-b37a-ec02c2ea9239 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 204 len: 0 microversion: 2.1 time: 0.130387 Jun 30 16:02:36.290223 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 538/1079] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:02:36 2022] DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:02:36.299518 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:36.300170 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:36.306511 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.306957 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.307708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:36.308167 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:36.446580 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:02:36.458517 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a1a1461b-318f-46a4-b65b-16421b30709f tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1682 microversion: 2.1 time: 0.163735 Jun 30 16:02:36.459308 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 542/1080] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:36 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:02:37.483060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:37.484355 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:37.495187 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:37.495940 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:37.497245 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:37.497968 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:37.639389 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.policy [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129450) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:02:37.650855 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e2d284f6-aa24-4651-a632-9989d208480e tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1682 microversion: 2.1 time: 0.174776 Jun 30 16:02:37.651576 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 539/1081] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:37 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:02:38.668485 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:38.669082 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:38.676477 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:38.676935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:38.677739 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:38.678155 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:38.764303 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.policy [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff354a709914b99bee9785b9577781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c05e9d2132f446a93aba1f27c37b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129449) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:02:38.772147 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2219d821-8e62-45e3-b961-82f053e9ad14 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 200 len: 1614 microversion: 2.1 time: 0.107738 Jun 30 16:02:38.772684 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 543/1082] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:38 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:02:38.956967 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [req-ee9ec6a2-5a4e-4400-aa1f-d782612d43b7 req-63b7e37e-e3fb-49e5-8df4-55efa348b422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ced8e9-2e44-4dc6-9422-5d3b9817d47d", "name": "network-vif-deleted", "tag": "91ffd1ab-70d9-4fef-bffb-d4b8898d46ba"}]} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:02:38.965721 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ee9ec6a2-5a4e-4400-aa1f-d782612d43b7 req-63b7e37e-e3fb-49e5-8df4-55efa348b422 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:38.968225 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [req-ee9ec6a2-5a4e-4400-aa1f-d782612d43b7 req-63b7e37e-e3fb-49e5-8df4-55efa348b422 service nova] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:38.989204 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.compute.server_external_events [req-ee9ec6a2-5a4e-4400-aa1f-d782612d43b7 req-63b7e37e-e3fb-49e5-8df4-55efa348b422 service nova] Creating event network-vif-deleted:91ffd1ab-70d9-4fef-bffb-d4b8898d46ba for instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d on hv-cinder-79760 Jun 30 16:02:38.997298 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [req-ee9ec6a2-5a4e-4400-aa1f-d782612d43b7 req-63b7e37e-e3fb-49e5-8df4-55efa348b422 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044088 Jun 30 16:02:38.997904 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 540/1083] 10.222.0.50 () {64 vars in 1317 bytes} [Thu Jun 30 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:39.789710 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:39.790338 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:39.797592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:39.798020 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:39.798797 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:39.799204 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:39.815590 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d HTTP/1.1 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:39.817300 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:39.819117 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'a3ced8e9-2e44-4dc6-9422-5d3b9817d47d'} Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:39.820034 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:39.821489 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:39.822773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:39.822773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-a4d7693a-668d-4331-bc03-1145edb7ec93 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 404 len: 111 microversion: 2.1 time: 0.033054 Jun 30 16:02:39.822773 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 544/1084] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:39 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:39.828843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e43e19e2-7c9e-446f-a6f9-e2522b85a6e9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '.version_select at 0x7fbbdeec8d30>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:39.849970 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e43e19e2-7c9e-446f-a6f9-e2522b85a6e9 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239445855" status: 202 len: 0 microversion: 2.1 time: 0.025430 Jun 30 16:02:39.850613 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 541/1085] 10.222.0.50 () {58 vars in 1220 bytes} [Thu Jun 30 16:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239445855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:02:41.599032 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:41.599566 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:41.606839 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:41.607294 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:41.608096 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:41.608534 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:41.622403 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d HTTP/1.1 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:41.623947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.625474 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'a3ced8e9-2e44-4dc6-9422-5d3b9817d47d'} Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:41.626315 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.627850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.629366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:41.629366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-c5f1c091-0b14-47f3-8174-81d15f5fc390 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 404 len: 111 microversion: 2.1 time: 0.030403 Jun 30 16:02:41.629366 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 545/1086] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:02:41 2022] DELETE /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:41.634667 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:41.635405 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: a3ced8e9-2e44-4dc6-9422-5d3b9817d47d] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:41.641979 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:41.642429 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:41.643194 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:41.643629 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:41.657163 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d HTTP/1.1 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:41.658775 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.660399 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'a3ced8e9-2e44-4dc6-9422-5d3b9817d47d'} Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:41.661332 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. Jun 30 16:02:41.662621 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:41.663803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance a3ced8e9-2e44-4dc6-9422-5d3b9817d47d could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:41.663803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-e56bd27a-b568-45e0-82f0-6082490be1ae tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d" status: 404 len: 111 microversion: 2.1 time: 0.029911 Jun 30 16:02:41.663803 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 542/1087] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:41 2022] GET /compute/v2.1/servers/a3ced8e9-2e44-4dc6-9422-5d3b9817d47d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:42.821616 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:42.822127 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:42.829129 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.829564 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.830316 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.830921 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.845672 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b HTTP/1.1 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:42.847211 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.848845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'ea1da3fc-6a87-4e21-865a-79a1a853eb9b'} Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:42.850010 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.851556 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.853233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:42.853233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-683ee25a-432d-4789-8477-a347e4d292fb tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 404 len: 111 microversion: 2.1 time: 0.030954 Jun 30 16:02:42.853233 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 546/1088] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:02:42 2022] DELETE /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:42.859063 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:42.859710 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: ea1da3fc-6a87-4e21-865a-79a1a853eb9b] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:42.866391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.866840 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.867603 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.868060 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.881280 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b HTTP/1.1 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:42.882804 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.884536 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'ea1da3fc-6a87-4e21-865a-79a1a853eb9b'} Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:42.885623 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. Jun 30 16:02:42.887229 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.888913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance ea1da3fc-6a87-4e21-865a-79a1a853eb9b could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:42.888913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-ea30980c-79d8-4871-bcb0-ba5ff5309e51 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b" status: 404 len: 111 microversion: 2.1 time: 0.030857 Jun 30 16:02:42.888913 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 543/1089] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:42 2022] GET /compute/v2.1/servers/ea1da3fc-6a87-4e21-865a-79a1a853eb9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:42.892947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:42.893448 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:42.899601 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.900047 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.900859 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.901263 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.914758 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e HTTP/1.1 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:42.916321 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.917920 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '56e0a0af-66ed-46c0-955c-b042acc8f51e'} Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:42.919019 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.920626 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.922255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:42.922255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-985fdc54-7761-4a33-a2dd-dc57ec444d2a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 404 len: 111 microversion: 2.1 time: 0.028707 Jun 30 16:02:42.922255 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 547/1090] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:02:42 2022] DELETE /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:42.926036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:42.926650 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 56e0a0af-66ed-46c0-955c-b042acc8f51e] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:42.932749 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.933196 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.933960 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:42.934391 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:42.947788 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e HTTP/1.1 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:42.949366 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.951028 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '56e0a0af-66ed-46c0-955c-b042acc8f51e'} Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:42.952208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. Jun 30 16:02:42.953746 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:42.957827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 56e0a0af-66ed-46c0-955c-b042acc8f51e could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:42.957827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-809f2d61-9679-4085-bc23-2661da044409 tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e" status: 404 len: 111 microversion: 2.1 time: 0.028638 Jun 30 16:02:42.957827 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 544/1091] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:42 2022] GET /compute/v2.1/servers/56e0a0af-66ed-46c0-955c-b042acc8f51e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:44.110330 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:44.110850 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.compute.api [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129449) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:44.117708 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:44.118164 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:44.118932 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:44.119361 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG oslo_concurrency.lockutils [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:44.134212 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf HTTP/1.1 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:44.135784 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: > Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.137453 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '68450f6e-540e-4501-8cfd-8d4e0073edbf'} Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:44.138248 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.139577 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.140901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:44.140901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-44445396-defa-45d7-93fa-79036965a57a tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 404 len: 111 microversion: 2.1 time: 0.030878 Jun 30 16:02:44.140901 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 548/1092] 10.222.0.50 () {58 vars in 1238 bytes} [Thu Jun 30 16:02:44 2022] DELETE /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:44.145988 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Calling method '>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:44.146601 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.compute.api [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] [instance: 68450f6e-540e-4501-8cfd-8d4e0073edbf] Fetching instance by UUID {{(pid=129450) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:02:44.153395 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:44.153843 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:44.154762 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:02:44.155200 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG oslo_concurrency.lockutils [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Lock "cd19ca04-a640-4a78-ac68-5d02ec66a735" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:02:44.169527 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] HTTP exception thrown: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Request method failure captured: Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf HTTP/1.1 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivcgl9Bovg_qTjWGqUyr_WSSWO6KbyY1p9syIW2wm4igImG3o0asGrhERKWvoUIWQTPavp5prLdWUvn-LQW2UHy8yb6dKWmzLwCQPWti1dr_LjtgOZYic3fSro40tMkZsCSgjZugUmAfoO0IowRChl_YSBquvyeu1u733XGCLhsaxq2g Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:44.171042 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6c05e9d2132f446a93aba1f27c37b412", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6c05e9d2132f446a93aba1f27c37b412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 6c05e9d2132f446a93aba1f27c37b412 Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447493447 Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 9ff354a709914b99bee9785b9577781d Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-AttachVolumeNegativeTest-1447493447-project Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: > Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.173030 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': '68450f6e-540e-4501-8cfd-8d4e0073edbf'} Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:44.173976 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. Jun 30 16:02:44.175582 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:44.177151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] Returning 404 to user: Instance 68450f6e-540e-4501-8cfd-8d4e0073edbf could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:44.177151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a31cbaae-df07-44f2-af1f-7710ffde3f0d tempest-AttachVolumeNegativeTest-1447493447 tempest-AttachVolumeNegativeTest-1447493447-project] 10.222.0.50 "GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf" status: 404 len: 111 microversion: 2.1 time: 0.030353 Jun 30 16:02:44.177151 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 545/1093] 10.222.0.50 () {58 vars in 1235 bytes} [Thu Jun 30 16:02:44 2022] GET /compute/v2.1/servers/68450f6e-540e-4501-8cfd-8d4e0073edbf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:48.581537 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-da4c9384-7fb1-4be6-b3b1-7a93a97166c2 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Action: 'create', calling method: .version_select at 0x7fbbda442700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-272981051"}} {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:02:48.893470 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-da4c9384-7fb1-4be6-b3b1-7a93a97166c2 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.435914 Jun 30 16:02:48.894119 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 549/1094] 10.222.0.50 () {60 vars in 1154 bytes} [Thu Jun 30 16:02:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 437 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 16:02:48.906810 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-5cf16b52-881f-46ef-821c-105fc2a0cffe tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbdee84550>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:48.964510 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-5cf16b52-881f-46ef-821c-105fc2a0cffe tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 200 len: 344 microversion: 2.1 time: 0.063308 Jun 30 16:02:48.965091 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 546/1095] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 16:02:48 2022] GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:02:49.981379 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-d5fd1616-46ff-40ae-a9c0-c0f0b75bd2d5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda6cb280>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:50.036856 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-d5fd1616-46ff-40ae-a9c0-c0f0b75bd2d5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 200 len: 345 microversion: 2.1 time: 0.062083 Jun 30 16:02:50.037417 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 550/1096] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 16:02:49 2022] GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:50.049480 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-7fd0b7fc-800c-461e-ae82-7f4baf7c8813 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Action: 'create', calling method: .version_select at 0x7fbbdaf53700>, body: {"snapshot": {"volume_id": "eff5c7d2-1b57-4e90-8038-c7e8ef0ad906", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1476330738"}} {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:02:50.230427 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-7fd0b7fc-800c-461e-ae82-7f4baf7c8813 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.185431 Jun 30 16:02:50.231134 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 547/1097] 10.222.0.50 () {60 vars in 1161 bytes} [Thu Jun 30 16:02:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:50.241539 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-9bb4e095-de0b-441f-82b0-1b8d6e1b6540 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda4579d0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:50.274225 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-9bb4e095-de0b-441f-82b0-1b8d6e1b6540 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 287 microversion: 2.1 time: 0.036642 Jun 30 16:02:50.274794 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 551/1098] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:50 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:50.286434 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-a530dbea-f7e4-4cb2-8ac9-fc38f85897de tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbdb340550>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:50.317269 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-a530dbea-f7e4-4cb2-8ac9-fc38f85897de tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034706 Jun 30 16:02:50.317833 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 548/1099] 10.222.0.50 () {58 vars in 1139 bytes} [Thu Jun 30 16:02:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:50.328477 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-de7ab600-5306-4737-94a7-ec6025428dee tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda64f3a0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:50.357503 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-de7ab600-5306-4737-94a7-ec6025428dee tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 287 microversion: 2.1 time: 0.032901 Jun 30 16:02:50.358055 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 552/1100] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:50 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:51.374071 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-88e3788a-8b94-4aec-abe6-154ed0ca6e48 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda55a670>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:51.411546 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-88e3788a-8b94-4aec-abe6-154ed0ca6e48 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 287 microversion: 2.1 time: 0.044719 Jun 30 16:02:51.412144 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 549/1101] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:51 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:52.428371 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-58485efc-8489-4bb6-9156-09673d6da3da tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda3f9700>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:52.462935 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-58485efc-8489-4bb6-9156-09673d6da3da tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 287 microversion: 2.1 time: 0.042032 Jun 30 16:02:52.463501 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 553/1102] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:52 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:53.476117 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cbb25378-3db5-46e9-8f3a-897f9545cbfe tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda5ccd30>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:53.507237 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cbb25378-3db5-46e9-8f3a-897f9545cbfe tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 288 microversion: 2.1 time: 0.035598 Jun 30 16:02:53.507787 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 550/1103] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:53 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:53.518709 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-5d3391d3-5e92-4053-a2b2-792adcf9c909 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda6cb5e0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:53.582271 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-5d3391d3-5e92-4053-a2b2-792adcf9c909 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 202 len: 0 microversion: 2.1 time: 0.067884 Jun 30 16:02:53.582845 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 554/1104] 10.222.0.50 () {58 vars in 1253 bytes} [Thu Jun 30 16:02:53 2022] DELETE /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:02:53.591044 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-eda31aa6-6356-4553-af63-d94df0c87ed3 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda55a5e0>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:53.622205 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-eda31aa6-6356-4553-af63-d94df0c87ed3 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 200 len: 287 microversion: 2.1 time: 0.034614 Jun 30 16:02:53.622896 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 551/1105] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:53 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:54.632282 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_api:SELECT=20 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:54.633046 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG dbcounter [-] [129449] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:54.637500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2cb39cfd-4644-4c6c-a7ef-f3befb1794cd tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda733c10>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:54.663455 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-2cb39cfd-4644-4c6c-a7ef-f3befb1794cd tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] HTTP exception thrown: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2cb39cfd-4644-4c6c-a7ef-f3befb1794cd tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Request method failure captured: Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc HTTP/1.1 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivckoGhqJ28QIW7RAHcEq3p9RuSMMtS9XBdxZBVndTF-bEdx2AO4XeAbm-jHfopwRGbeMUUdwPlLVpbeAd3HUPPysNYggUmjdNRunHYs9uW6Bn3dWofwBhnyjCQHoqaMods5bb9cZr2sUB7r87SMU4CFg4shn_qVKtmZ9FbxqSLR1lsQ Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:54.666897 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1a347e7e2a624c8ba2644d785f9748a7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 8e904707a1cd4ea9b1fe546e96e5c3e5 Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': '9db8dae8-979e-4a53-a74d-4267e1b3eadc'} Jun 30 16:02:54.668592 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. (HTTP 404) (Request-ID: req-9a068ba7-ddc8-463f-b078-83246fd634a2) Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.669663 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:54.671113 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 16:02:54.672730 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-2cb39cfd-4644-4c6c-a7ef-f3befb1794cd tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Returning 404 to user: Snapshot 9db8dae8-979e-4a53-a74d-4267e1b3eadc could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:54.674500 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-2cb39cfd-4644-4c6c-a7ef-f3befb1794cd tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc" status: 404 len: 111 microversion: 2.1 time: 0.036972 Jun 30 16:02:54.676115 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 555/1106] 10.222.0.50 () {58 vars in 1250 bytes} [Thu Jun 30 16:02:54 2022] GET /compute/v2.1/os-snapshots/9db8dae8-979e-4a53-a74d-4267e1b3eadc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:54.676224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:54.676224 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG dbcounter [-] [129450] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:02:54.680103 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-f0f3a19a-a392-41c7-9fa3-fdf8297adca0 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbdaf53790>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:54.747721 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-f0f3a19a-a392-41c7-9fa3-fdf8297adca0 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 202 len: 0 microversion: 2.1 time: 0.074381 Jun 30 16:02:54.748370 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 552/1107] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 16:02:54 2022] DELETE /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:02:54.756851 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-909f2109-7769-4412-a9ae-39ba74e52ace tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda6cbaf0>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:54.808252 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-909f2109-7769-4412-a9ae-39ba74e52ace tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 200 len: 344 microversion: 2.1 time: 0.055160 Jun 30 16:02:54.811899 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 556/1108] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 16:02:54 2022] GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:02:55.826320 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cff59877-351c-4ca8-9ef8-8ecb85f8393f tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda706160>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:55.861816 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-cff59877-351c-4ca8-9ef8-8ecb85f8393f tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] HTTP exception thrown: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cff59877-351c-4ca8-9ef8-8ecb85f8393f tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Request method failure captured: Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 HTTP/1.1 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivckoGhqJ28QIW7RAHcEq3p9RuSMMtS9XBdxZBVndTF-bEdx2AO4XeAbm-jHfopwRGbeMUUdwPlLVpbeAd3HUPPysNYggUmjdNRunHYs9uW6Bn3dWofwBhnyjCQHoqaMods5bb9cZr2sUB7r87SMU4CFg4shn_qVKtmZ9FbxqSLR1lsQ Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:55.865040 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1a347e7e2a624c8ba2644d785f9748a7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 8e904707a1cd4ea9b1fe546e96e5c3e5 Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'eff5c7d2-1b57-4e90-8038-c7e8ef0ad906'} Jun 30 16:02:55.866755 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. (HTTP 404) (Request-ID: req-9c61c9b1-3aec-428e-9ef6-9f312bdb1bdc) Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.868036 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:55.869521 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:02:55.870962 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-cff59877-351c-4ca8-9ef8-8ecb85f8393f tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Returning 404 to user: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-cff59877-351c-4ca8-9ef8-8ecb85f8393f tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 404 len: 109 microversion: 2.1 time: 0.047550 Jun 30 16:02:55.872560 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 553/1109] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 16:02:55 2022] GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:55.882006 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f8cdaf01-08f3-4240-a92c-0c147779bdf5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda3f9790>' {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:55.909254 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.wsgi [None req-f8cdaf01-08f3-4240-a92c-0c147779bdf5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] HTTP exception thrown: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f8cdaf01-08f3-4240-a92c-0c147779bdf5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Request method failure captured: Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: request: DELETE /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 HTTP/1.1 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept: application/json Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Accept-Encoding: identity Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Connection: close Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Length: 0 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Content-Type: application/json Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Host: 10.222.0.50 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Openstack-System-Scope: None Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Auth-Token: gAAAAABivckoGhqJ28QIW7RAHcEq3p9RuSMMtS9XBdxZBVndTF-bEdx2AO4XeAbm-jHfopwRGbeMUUdwPlLVpbeAd3HUPPysNYggUmjdNRunHYs9uW6Bn3dWofwBhnyjCQHoqaMods5bb9cZr2sUB7r87SMU4CFg4shn_qVKtmZ9FbxqSLR1lsQ Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Id: None Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Domain-Name: None Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Identity-Status: Confirmed Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Is-Admin-Project: True Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Id: default Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Domain-Name: Default Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Role: member,reader Jun 30 16:02:55.911307 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Roles: member,reader Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1a347e7e2a624c8ba2644d785f9748a7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Id: default Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Domain-Name: Default Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Id: 8e904707a1cd4ea9b1fe546e96e5c3e5 Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: method: Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: exception: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: action_args: {'id': 'eff5c7d2-1b57-4e90-8038-c7e8ef0ad906'} Jun 30 16:02:55.912971 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: {{(pid=129449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. (HTTP 404) (Request-ID: req-f509be86-feeb-415c-96b2-b9e5ec88b2c0) Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.914171 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:02:55.915665 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 16:02:55.917541 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: DEBUG nova.api.openstack.wsgi [None req-f8cdaf01-08f3-4240-a92c-0c147779bdf5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Returning 404 to user: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. {{(pid=129449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO nova.api.openstack.requestlog [None req-f8cdaf01-08f3-4240-a92c-0c147779bdf5 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 404 len: 109 microversion: 2.1 time: 0.035167 Jun 30 16:02:55.918986 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: [pid: 129449|app: 0|req: 557/1110] 10.222.0.50 () {58 vars in 1247 bytes} [Thu Jun 30 16:02:55 2022] DELETE /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:02:55.921219 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-506e2a2f-7b21-41db-abc2-03a212e97824 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Calling method '.version_select at 0x7fbbda706e50>' {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:02:55.948299 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.wsgi [None req-506e2a2f-7b21-41db-abc2-03a212e97824 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] HTTP exception thrown: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-506e2a2f-7b21-41db-abc2-03a212e97824 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Request method failure captured: Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: request: GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 HTTP/1.1 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept: application/json Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Accept-Encoding: identity Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Connection: close Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Length: 0 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Content-Type: application/json Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Host: 10.222.0.50 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Openstack-System-Scope: None Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: User-Agent: python-urllib3/1.26.9 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Auth-Token: gAAAAABivckoGhqJ28QIW7RAHcEq3p9RuSMMtS9XBdxZBVndTF-bEdx2AO4XeAbm-jHfopwRGbeMUUdwPlLVpbeAd3HUPPysNYggUmjdNRunHYs9uW6Bn3dWofwBhnyjCQHoqaMods5bb9cZr2sUB7r87SMU4CFg4shn_qVKtmZ9FbxqSLR1lsQ Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Id: None Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Domain-Name: None Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Identity-Status: Confirmed Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Is-Admin-Project: True Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Id: default Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Domain-Name: Default Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Role: member,reader Jun 30 16:02:55.950216 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Roles: member,reader Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1a347e7e2a624c8ba2644d785f9748a7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1a347e7e2a624c8ba2644d785f9748a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Id: 1a347e7e2a624c8ba2644d785f9748a7 Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918799405 Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Id: default Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Domain-Name: Default Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Id: 8e904707a1cd4ea9b1fe546e96e5c3e5 Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918799405-project Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: method: Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: exception: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: action_args: {'id': 'eff5c7d2-1b57-4e90-8038-c7e8ef0ad906'} Jun 30 16:02:55.952023 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: {{(pid=129450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. (HTTP 404) (Request-ID: req-425cb0fb-5479-4f66-9c2d-3e9ce1c1206f) Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.953106 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:02:55.954651 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:02:55.956142 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: ERROR nova.api.openstack.wsgi Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: DEBUG nova.api.openstack.wsgi [None req-506e2a2f-7b21-41db-abc2-03a212e97824 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] Returning 404 to user: Volume eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 could not be found. {{(pid=129450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO nova.api.openstack.requestlog [None req-506e2a2f-7b21-41db-abc2-03a212e97824 tempest-VolumesSnapshotsTestJSON-918799405 tempest-VolumesSnapshotsTestJSON-918799405-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906" status: 404 len: 109 microversion: 2.1 time: 0.034220 Jun 30 16:02:55.957786 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: [pid: 129450|app: 0|req: 554/1111] 10.222.0.50 () {58 vars in 1244 bytes} [Thu Jun 30 16:02:55 2022] GET /compute/v2.1/os-volumes/eff5c7d2-1b57-4e90-8038-c7e8ef0ad906 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:04:08.936718 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:04:08.937793 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Thu Jun 30 16:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:04:09.199694 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:04:09.200671 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 16:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:07:20.138947 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:07:20.141237 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 16:07:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:07:28.949148 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:07:28.950056 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Thu Jun 30 16:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:07:29.213648 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:07:29.214588 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 16:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:07:44.210343 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:07:44.211208 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Thu Jun 30 16:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:07:58.109114 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:07:58.110152 dv-cinder-797608-40-iscsi devstack@n-api.service[129450]: Thu Jun 30 16:07:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:08:01.471094 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:08:01.471961 dv-cinder-797608-40-iscsi devstack@n-api.service[129449]: Thu Jun 30 16:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!